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1 .  Introduction 


This  report  is  Intended  to  guide  indtvidi  Is  working  in  the  area 
of  optimization  in  the  use  of  SYMBOLIC  FACTORABLE  SUMT,  a  computer  pro¬ 
gramming  model,  to  code,  solve,  and  conduct  sensitivity  analysis  studies 
on  parametric  mathematical  optimization  problems  of  the  following  general 
structure: 


who  re 


and  yr.E 


minimize  F(x,y) 


subje 

ct  to 
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corresponds  to  the  problem  parameters. 


Since  its  development,  SUMT-Version  4  [l|  has  undergone  a  series 
of  modifications  and  refinements;  SYMBOLIC  FACTORABLE  SUMT  is  its  latest 


version.  The  primary  Incentive  for  such  modifications  has  been  to  relax 
the  coding  of  the  problem  functions  and  their  first  and  second  deriva¬ 
tives,  required  by  SUMT-Version  4  as  users'  subroutines,  which  in  many 
cases  have  proved  to  be  cumbersome,  time  consuming,  costly,  and  prone  to 
various  derivational  and  coding  errors.  Table  13,  provided  in  Section  4 
for  sample  example  3,  supports  this  claim. 

The  computer  program  reported  here  is  an  outgrowth  of  the  program 
developed  by  McCormick  [2],  The  rationale  for  such  an  attempt  was  the 
fact  that 

"Almost  every  nonlinear  function  can  systematically  be  decom¬ 
posed  to  (and  hence  synthesized  from)  simple  functions  of  one 
variable. " 

Using  this  fact,  which  in  essence  constitutes  the  backbone  struc¬ 
ture  of  factorable  programming — the  topic  of  the  next  section — McCormick 
developed  a  series  of  subroutines  which  internally  calculated  the  values 
and  the  first  and  second  derivatives  of  single  variable  functions,  many 
of  which  are  listed  in  Table  12.  Each  of  these  functions  was  associated 
with  a  numeric  code,  called  a  transformation  code,  which  aided  their 
ident t f icat ion  in  the  routines.  Another  subroutine  was  provided  to  syn¬ 
thesize  any  desired  combination  of  these  single  variable  functions  to 
reconstruct  the  intended  problem  functions.  Interface  of  these  routines 
with  those  of  SUMT-Version  4  relaxed  the  provision  of  the  user's  sub¬ 
routines  to  the  model .  In  fact,  the  user's  task  boiled  down  to  decom¬ 
position  of  his  problem  functions  to  functions  of  single  variables  and 
earmarking  them  with  appropriate  transformation  codes.  Tills  was  a  major 
breakthrough  which  to  a  great  extent  alleviated  the  user's  task  in  coding 
and  solving  optimization  problems,  and  brought  about  significant 
savings  of  the  time  and  cost  involved  in  those  steps. 

Yet  another  attempt  to  facilitate  the  coding  of  problems  was  by 
deSilva  and  McCormick  [31,  through  which  evolved  the  original  version  of 
SYMBOLIC  FACTORABLE  SUMT.  The  essential  task  in  [3]  was  to  associate 
relevant  symbolic  names  with  individual  transformat  ion  codes  which  aided 
the  identification  of  single  variable  functions  in  the  model  software. 


oj 


Km tlu'  rrooro,  this  version  permit  tod  symbolic  input  tor  the  problem  vari¬ 
ables  and  parameter  names  of  up  to  four  characters.  In  addition,  it 
simplified  the  coding  of  the  problems  so  that  users  could  readily  acquaint 
themselves  with  the  symbolic  names  of  various  single  variable  functions, 
and  could  then  code  the > r  problems  without  frequent  reference  to  the 
manual.  This  was  not  the  case  in  the  earlier  version,  because  the  single 
variable  functions  had  to  be  associated  with  the  related  transformation  codes. 

1. ater,  by  exploiting  the  relative  merits  of  factorable  functions,  deSilva 
and  McCormick  developed  new  routines  to  calculate  a  weighted  cumulative 
sensitivity  of  the  components  of  a  solution  vector  with  respect  to  prob¬ 
lem  parameters  ,TV  x*  [Appendix  2,  Equation  (37)1.  The  underlying 

theory  for  the  above  developments  is  fully  explained  in  [4],  which  is 
included  in  Appendix  2  for  reference  by  the  interested  user. 

This  latter  version  has  recently  been  further  modified  and  re- 
tined  by  the  authors  to  calculate  sensitivity  information  for  the  indi¬ 
vidual  components  of  the  solution  vector  x*  with  respect  to  the  problem 

dx*  dx*/x* 

parameters  y  (i.e.,  - —  )  and  corresponding  elasticities  (i.o.,  -  -  ) 

-  i  dy*/y* 

J  J 

for  i=l,...,n;  j=l,...,k  .  In  order  to  enhance  its  scope,  a  few  more 
functions  ol  a  single  variable  have  been  added  to  the  model.  This 
latest  version  of  the  model  is  compiled  at  The  George  Washington  Univer¬ 
sity  IBM/370,  and  can  be  accessed  with  the  aid  of  job  control  cards,  as 
depicted  in  Figures  2  or  3  of  Section  4. 

2.  Factorable  Functions 

Most  functions  of  several  variables  used  in  nonlinear  optimization 
are  complicated  compositions  of  transformed  sums  and  products  of  functions 
o  '  single  variable.  Once  this  observation  is  made  formal,  an  outline 
of  n  automatic  computer-oriented  way  of  representing  nonlinear  program¬ 
ming  problems  becomes  clear. 
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Definition:  A  function  f(x  is  a  factorable  function  of  sever¬ 

al  variables  if  it  can  be  represented  as  the  last  in  a  finite  sequence  of 
functions  f^(x)  ,  which  are  composed  as  follows: 

fJ(x)  =  x^  ,  for  j-l,...,n  . 

For  n  <  J  ,  f'1  (x)  is  either  of  the  form 

ik(x)  +  f{(x)  ,  k,2  <  j  , 

or  of  the  form 

fk(x)  •  f  ^(x)  ,  k, 2  <  j  , 

or  of  the  form 

T[fk(x)l  ,  k  <  j  , 

where  T(f)  is  a  function  of  a  single  variable. 

It  should  be  emphasized  that  this  is  a  natural  way  of  looking  at 

functions  of  several  variables,  since  it  corresponds  to  the  way  they  are 

used  when  evaluated  at  a  particular  set  of  values  of  the  vector  (x^,..., 

x  )  . 
n 


When  a  function  is  represented  in  factorable  form,  the  computation 
of  its  gradient  vector  and  Hessian  matrix  of  second  derivatives  becomes 
very  simple.  Consider  the  general  form  for  the  gradient  and  Hessian  ma¬ 
trix  of  a  function  which  is  either  the  sum  of  two  functions,  the  product 
of  two  functions,  or  a  transformation  (function  of  one  variable)  of  a 
function.  For  example. 


V l f (x)+g(x) 1 

=  Vf (x)  +  Vg(x) 

V f  f  (x)  •  g ( x)  ] 

=  Vf (x)  •  g(x)  +  Vg(x)  •  f(x) 

(1) 

VT [ f ( x ) ] 

=  Vf (x)  •  T [ f (x)  ]  , 

(2) 

-  4  - 


where  T(f)  =  3T(f)/9f  ;  and 


T-402 


V2[f(x)+g(x)]  =  V2f(x)  +  V2g(x) 

V2{ f (x) *g(x) ]  =  V2f(x)  •  g(x)  +  V2g(x)  •  f(x)  (3) 

+  Vf(x)  *  VTg(x)  +  Vg(x)  •  VTf(x)  , 

V2[T|f(x)]]  =  V2f(x)  •  T[f(x)]  +  Vf(x)T[f(x)]VTf(x)  ,  (4) 

where  T(f)  =  a2T(f)/9f2  . 

Several  points  should  be  noted. 

(i)  The  computation  of  (1)  involves  f(x),g(x)  ,  which  would 
already  have  been  computed  in  order  to  evaluate  their 
product . 

(ii)  The  computation  of  (3)  involves  Vf(x),  Vg(x)  ,  which  would 
already  have  been  computed  in  order  to  evaluate  (1). 

(iii)  Equation  (4)  used  T[f(x)]  ,  which  was  previously  needed  in 

(2). 

(iv)  By  induction,  it  follows  that  Hessian  matrices  of  factor¬ 
able  functions  are  naturally  given  as  sums  of  outer  prod¬ 
ucts  of  vectors,  i.e., 

^ui(x)ai(x)vi(x)  +  vi(x)a1(x)u1(x)  , 

where  u^(x)  ,  v^(x)  are  n  x  1  vectors,  a. Ax)  are 
scalars,  and  the  u^(x)  ,  v^(x)  are  available,  having  been 
required  for  the  gradient  computation. 

For  those  optimization  problems  which  are  factorable,  the  factor¬ 
able  nonlinear  programming  problem  is  written  in  a  more  compact  form 
(often  referred  to  as  canonical  factorable  form): 

minimize  XN(x) 
n 

xCE 

subject  to  <  X*(x)  <  , 

-  5  - 
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for  i«l,...,N-l  (possibly  L  =  and/or  l!.  =  4"*)  ,  whore  X*  (x)  = 
(for  ,  and  the  remainder  are  defined  recursively  as  fol¬ 

lows:  given  XP(x)  ,  for  p“l,...,i-l  ,  then  for  i=n+l,...,N  , 


where  the  T's,  U's,  and  V's  are  functions  of  a  sing  Jr  variable.  The 

functions  X*(x)  ,  i=l,...,N  are  usually  referred  to  as  concomitant 

variable  functions  and  abbreviated  as  CVFs.  Also,  XX(x)  ,  i*=n+l,...,N 
are  referred  to  as  new  CVFs. 

An  important  point  bears  mentioning  here.  One  of  the  many  appeal¬ 
ing  features  of  coding  and  solving  problems  in  factorable  form  is  that 
they  lend  themselves  in  a  natural  way  to  the  computation  of  the  number  of 
functional  evaluations  and  arithmetic  operations  involved  in  the  evalua¬ 
tion  of  problem  functions,  and  in  the  first  and  second  derivatives  re¬ 
quired  for  solution  of  nonlinear  optimization  problems.  By  doing  so,  a 
precise  quantitative  measure  is  provided  for  comparing  algorithms  devised 
for  solving  nonlinear  optimization  problems. 

Following  are  two  examples  that  demonstrate  these  ideas. 

Example  i  [putting  a  function  into  factorable  form]. 

Consider  the  following  function: 

W  ■  r*B(x.+x9)  (<l  x  +1!  x  +t  x  )|x  +  (x9-x9)  1  , 

1  Z  t  A  m  5  b  6  L  Z  3 

which  corresponds  to  the  objective  function  of  the  sample  problem  5  pro¬ 
vided  in  Section  4.3,  where 

r*B  *  3716.6 

i.  -  495 

t 

4  =*  385 

m 

L  -  315  . 

b 

-  6  - 
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Tab lt>  1  shows  how  this  function  is  put  into  simple  factorable  form,  and 
depicts  the  corresponding  stepwise  reconstruction  of  the  function. 


HxtunpLi'  it  (putting  an  optimization  problem  into  canonical  factorable 
form] . 

Consider  the  following  optimization  problem,  which  corresponds  to 
the  sample  example  1  provided  in  Section  4.1: 

minimize  f  =  (Xj-10)2  +  (x.,-1)" 

>  x2 

subject  to  gj :  -  5  sin  .  5Xj  <  C( 


g2: 

g3: 


x2  ~  C6  £n  Xj  >  C2 


X1X2 


>  C, 


where 


84! 


>  C 


4  ’ 


C1  "  C2  “  ° 


3  ,  C, 


1.5  ,  C, 


1  .  C, 


-1.5 


are  the  parameters  of  the  problem.  Putting  the  functions  of  this  problem 
into  simple  factorable  form  goes  as  follows: 


Xl(x) 

- 

Xl 

X2(x) 

= 

X2 

X3(x) 

a 

. 5X1 (x) 

4 

X  (*) 

a 

Sin[X3(x)] 

X^x) 

* 

-  5X4(x) 

x\x) 

- 

C5  •  X2(x) 

X?(x) 

* 

X6(x)  +  X5(x) 

X®(x) 

S3 

in  (X3(x) ] 

X9(x) 

- 

-C6  •  X8(x) 

x'°(x) 

> 

2  9 

X  (x)  +  X  (x) 

(functional  form  of  g,) 

4 


(functional  form  of  g^) 


(functional  form  of  g^) 


7 


EXAMPLE  OF  FACTORABLE  FUNCTION  (EXAMPLE  i) 


original  function 
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XU(x) 

=  Xl(x)  •  X2(x) 

(functional  form  of  g^) 

X12(x) 

=  X1  (x)  -  10 

X13(x) 

12  2 
=  [X1Z(x)lZ 

XU(x) 

=  X2(x)  -  1 

X15(x) 

=  [X2(x)-1]2 

Xl6(x) 

13  15 

=  X  (x)  +  X  (x) 

(objective  function  f) 

Representing  x\x)  by  for  notational  simplicity,  one  canonical 

form  of  this  problem  will  read  as  follows: 


minimize  X 

x1,...,x15 


16 


where  X, 


=  x. 


2 

=  .5X1 

=  Sin  X^ 
=  -5X, 


=  c5x2 

=  X6+X5 

=  £nX, 


“C6X8 


10 


X2  +  X9 


11 


=  X, 


12 


'13 


xl  -  10 
(X12)2 


'14 


x2  -  1 


15 


(X14>‘ 


16 


subject  to  X., 


X13  +  X15 


<  C. 


(functional  form  of  g^) 


(functional  form  of  g^) 


(functional  form  of  g2> 
(functional  form  of  g^) 


(objective  function) 
<gx) 


-  9  - 
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10 

> 

C2 

(g,) 

11 

> 

C3 

(&3> 

1 

> 

C4 

(84)  • 

By  exploiting  the  definition  of  the  concomitant  variable  functions  given 
in  (5),  many  of  the  above  steps  may  be  combined  and  the  problem  may  be 
reformulated  (as  is  done  in  symbolic  codings)  more  concisely  as: 


minimize  X 
XCE6 

where  X*  =  x 


1 


X  =  x„ 


3  2  1 

X  =  C5X  -  3  sin  .5X 

x4  =  x2  -  C6  fcn  X1 

X5  =  X1  •  x2 


X6  =  (Xl-10)2  +  (X2-l)2 


subject  to  X  <  Cj 
4 

X  >  c2 
x5  >  c3 

XI  >  C, 

—  4 


(functional  form  of  g^) 

(functional  form  of  g^) 
(functional  form  of  g^) 
(functional  form  of  g^) 
(objective  function) 

(gj) 

(r2) 

(g3) 

(g^)  • 


3.  Input  Specifications 

This  section  describes  how  the  user  must  code  and  supply  the  re¬ 
quired  information  about  his  problem  to  SYMBOLIC  FACTORABLE  SUMT.  In  the 
following,  the  type  of  information  and  its  format,  name,  and  description 
are  discussed  in  the  same  order  that  must  appear  in  a  coded  deck.  A 
schematic  depiction  of  a  coded  problem  deck  structure  is  provided  in  Fig¬ 
ure  1  at  the  end  of  this  section.  For  clarification,  frequent  reference 
to  the  code  of  sample  problem  1  of  Section  4.1  and  to  Figures  2  or  3  is 
advised  for  beginners  as  they  proceed  through  the  input  specifications. 
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1  JOB  and  JCL  cards.  (See  Figure  2,  Section  4.1.4.) 


?.  The  SUMT  parameter  card.  The  SUMT  parameter  card,  which  is 
read  in  by  the  subroutine  MAIN,  is  described  in  Table  2. 

TABLE  2 


THE  SUMT  PARAMETER  CARD 


Columns 

Format 

Name 

Use 

01-12 

E12.0 

EPSI  (e) 

Tolerance  used  to  decide  if  an 
unconstrained  minimum  has  been 
achieved  for  each  subproblem 
(see  Option  9) 

13-24 

E12.0 

RHOIN  (r1) 

Possible  initial  value  of  r  (of¬ 
ten  set  at  1.0)  (see  Option  1) 

25-36 

E12.0 

THETAO  (eQ) 

Tolerance  used  to  decide  if  the 
solution  to  the  NLP  problem  (A) 
has  been  approximated  (see  Op¬ 
tion  5) 

37-48 

E12.0 

RATI0  (c) 

Parameter  (>  1)  used  to  compute 
consecutive  values  of  r;  = 
r^/c  (often  set  at  16.0) 

49-60 

E12.0 

TMMAX 

Maximum  amount  of  time  for  solv¬ 
ing  problem  (in  seconds) 

61-64 

14 

M 

Number  (integer)  of  inequality 
constraints,  (M+MZ)  <  200* 

65-68 

14 

N 

Number  (integer)  of  variables, 

N  <  100 

69-72 

14 

MZ 

Number  (integer)  of  equality 
constraints 

*The  limits  on  M+MZ  and  N  are  governed  by  the  sizes  of  the  arrays 
in  SUMT. 


3  The  first  option  card.  The  first  option  card,  which  is  read  in 
by  the  subroutine  MAIM,  is  described  in  Table  3. 


•r-402 


'l 


TABLE  3 

•HIE  FIRST  OPTION  CARO 


Option 

Column 

i  .  *  »  t  t  m  . 

Format 

Name 

Value 

Moan inR 

1 

(norma  1 1 y 
set  to  3) 

7 

I 

NT1 

3 

2 

14 

I 

NT2 

2 

3 

(normal ly 
set  to  l) 

21 

I 

NT  3 

1 

Standard  printout  (this  in¬ 
cludes  a  call  to  OUTPUT  af¬ 
ter  the  solution  of  every 
subproblem).  Also  the  esti¬ 
mates  of  the  "Lagrange  mul¬ 
tipliers"  and  first-  and 
second-order  solution  esti¬ 
mates  are  printed. 

2 

For  additional  printout  (in¬ 
cludes  standard  printout  and 
every  intermediate  point, 
gradient  of  P,  and  the  vec¬ 
tor  S) . 

4 

(normally 
set  to  1) 

28 

I 

NT4 

1 

Final  convergence  is  deter¬ 
mined  on  the  basis  of  cur¬ 
rent  solution  to  the  sub¬ 
problem. 

2 

Final  convergence  is  deter¬ 
mined  on  the  basis  of  the 
first  order  estima:os.  The 
first  order  estimate  of  the 
solution  vector  must  be 
close  to  feasible.  See  below. 

3 

Final  convergence  is  deter¬ 
mined  on  the  basis  of  the 
second  order  estimates.  The 
second  order  estimate  of  the 
solution  vector  must  be 
close  to  feasible  before  the 
convergence  check  is  made. 

If  x  is  a  solution  esti¬ 
mate  it  is  considered  close 
to  being  feasible  if  g^(x) 

+  00  >  0  ,  i-l,2 . m  , 

where  0^  is  defined  on  the 
parameter  card. 
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TABLE  3 — continued 


»  -  -  i  - 

Option 

.  :  -1  .  t  i 

Co 1 umn 

i  :  i  i-  i-S  : 

Format 

Name 

Value 

Meaning 

5 

35 

I 

NT  5 

The  convergence  criterion  de- 

(normally 

termining  the  NLP  problem 

set  to  1) 

has  been  solved  (only  use  = 

1  when  NT4  1) 

1 

Quit  when 

G  -  flx(r.  )] 

G[x(rk),y(rk),X(rk>]  '  0 

2 

Quit  when 

lr  Ij=1  gjlx(rk)l |  <  60 

3 

Quit  when 

first  order  estimate  of  v^ 

G(x(rk) ,u(rk) ,X(rk) 1 

1  <eo 

6 

42 

I 

NT  6 

1 

After  final  convergence  the 

(normally 

program  reads  in  new  data 

set  to  1) 

and  solves  the  next  problem 

2 

After  final  convergence  has 
been  determined  a  call  to 

PUNCH  is  made  before  pro¬ 
ceeding  on  to  the  next  prob¬ 
lem 

7 

49 

I 

NT  7 

First  move  after  a  minimum 

(normally 

to  a  subproblem  is  achieved 

set  to  1) 

i 

No  extrapolation 

2 

Extrapolate  through  last  two 
minima 

3 

Extrapolate  through  last 
three  minima 

8 

56 

I 

NT  8 

0 

No  sensitivity  or  elasticity 

(normally 

calculation 

set  to  0) 

2 

Conduct  sensitivity  and 
elasticity  calculation  after 
each  subproblem  convergence 
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Option 


Column 


9 

63 

I 

NT9 

Subproblem  convergence  cri¬ 
terion,  or  when  to  stop  min¬ 
imizing  P  function  for  fixed 
value  of  r  (see  parameter 
card) 

1 

Quit  when 

VxP(x1,r) |  <  G 

2 

Quit  when 

V  P(x‘  ,r)  <  P<?‘> 

3 

Quit  when  IV^PCx^.r) |  <  C 

10 

70 

I 

NT10 

1 

At  least  one  nonlinear  con¬ 
straint 

2 

Linear  constraints 

3 

Linear  constraints  and  lin¬ 
ear  objective  function 
(i.e.,  a  linear  programming 
problem) 

4  The  title  card.  This  card,  which  is  read  in  by  the  subroutine 
SYMPUT,  contains  all  pertinent  information  such  as  problem  title  and  ref¬ 
erence,  user's  name,  date,  etc.,  that  the  user  wishes  to  appear  on  the 
output.  This  information  must  be  coded  in  a  single  card  anywhere  in 
columns  1-80,  and  is  read  in  with  the  alphanumeric  format  of  20  A4.  A 
blank  card  must  be  supplied  if  this  information  is  not  coded. 

6  The  SYlfPUT  parameter  card.  The  SYMPUT  parameter  card,  which 
is  read  in  by  the  subroutine  SYMPUT,  is  described  in  Table  4. 
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THK  SYMPUT  PARAMETER  CARD 


Name 

N 

NN 

MMM 

MZ 

I  TEST 


IPR 


ITES 


L  X 


Description 


Number  of  problem  variables 

Number  of  concomitant  variable  func¬ 
tions,  CVFs  (l.e.,  number  of  variables 
in  factorable  form) 

Number  of  inequality  constraints 

Number  of  equality  constraints 

•  If  1TEST-0,  at  the  initial  feasible 
point  of  the  problem  the  values  ami 
first  and  second  derivatives  of  new 
CVFs  will  be  evaluated  and  printed  for 
debugging  purposes,  without  solving  the 
problem 

•  If  ITEST=1,  the  above  information 
will  be  suppressed  and  the  problem  will 
be  solved 

•  If  1PR=1,  after  each  subproblem  con¬ 
vergence  the  values  of  all  CVFs  at  the 
subnroblem  solution  point  will  he 
printed. 

•  If  IPR=0  (#1),  the  values  of  the  CVFs 
will  be  suppressed  after  each  subprob¬ 
lem  convergence 

•  If  ITF.S=2,  after  each  subproblem  con¬ 
vergence  the  following  information  will 
be  printed  for  debugging  purposes : 

(i)  Entries  of  vector 

( '’l 

(ii)  Entries  of  vector  or 
(iii)  Values  of  all  CVFs 
(iv)  Partial  derivatives  of  new  CVFs 
with  respect  to  problem  vari¬ 
ables  and  parameters 

(v)  Entries  of  vector  DELA^ ^ 

•If  ITES-0  (/2) ,  the  above  information 
will  be  suppressed  after  each  subprob¬ 
lem  convergence 
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TABLE  4 — ooniinued 


Co 1 umns 

Format 

**-*»•  -  «  * 

Name 

Descript  ion 

36-40 

Ic 

NSWIT 

•  if  NSW1T*1,  the  modified  listing  of 

. 

J 

the  coded  problem  and  related  tables 
set  up  by  subroutine  SYMPUT  will  be 
suppressed  in  the  output 
•  If  NSW1T*0  (jM),  the  above  listing 
will  not  be  suppressed 

41-45 

*5 

-  - 

I  ID 

Number  oi  problem  parameters  (i.e.,  P 
and  D  cards) 

1*1 .... ,n  (n  is  the 


^ ^Vector  a  Is  an  n-dimensional  unit  vector  e. 
number  of  original  problem  variables). 

(2) 

See  Equation  (38)  in  Appendix  2. 

( 3) 

'"^Negative  values  of  partial  derivatives  of  subproblem  solution  vec¬ 
tor  components  with  respect  to  the  problem  parameters. 


8  The  variable  definition  cards.  These  cards  are  read  in  by  the 
subroutine  SYMPUT.  For  each  variable  of  the  problem,  the  user  must  supply 
one  card  with  the  descriptions  as  shown  in  Table  5. 


TABLE  1 


THE  VAR I  ABLE  DEFINITION  CARDS 


t  v.  ^  -  - 1 

Columns 

Format 

X  -  1  .  -  S  *  J 

Name 

Descript  ion 

02 

A1 

ATYPK 

Letter  "v"  must  be  coded  tor  ATYPE  to 
indicate  this  card  corresponds  to  a 
variable  card 

04-07 

\ 

ANAME 

Variable  name  to  be  specified  by  the 
user  (right  justified) 

16-28 

- - 

FL2.5 

ARl. 

Initial  value  of  variable  (starting 
point ) 

It  is  obvious  that  the  number  of  variable  definition  cards  should  match 
the  number  of  the  (original)  variables  of  the  problem  being  coded. 
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These  curds  are 


02 


7  The  problem  parameter  cai\is  (P  and  D  cards). 

read  in  by  the  subroutine  SYMPUT .  For  each  parameter  of  the  problem, 
user  must  supply  one  card  with  a  description  as  shown  in  Table  b. 


the 


TABLE  6 

THE  PROBLEM  PARAMETER  CARDS 


Columns 

Format 

Name 

Description 

02 

A1 

ATYPE 

•  Letter  "D"  must  be  coded  for  ATYPE  to 

1 

indicate  this  card  corresponds  to  a  pa¬ 
rameter  card 

•  Use  of  letter  "P"  instead  of  letter 
"D",  in  conjunction  with  proper  option 
in  the  SUMT  parameter  card,  will  invoke 
the  sensitivity  routines  to  calculate 
the  sensitivity  and  elasticities  of  the 
solution  point  with  respect  to  the  in¬ 
dicated  parameter  after  each  subproblem 
convergence 

04-07 

A4 

ANAME 

Parameter  name  to  be  specified  by  the 
user  (right  justified) 

16-28 

F12.5 

ARG 

Numerical  value  of  the  parameter 

It  is  obvious  that  the  number  of  the  parameter  cards  must  match  the  number 
of  problem  parameters.  Also,  parameter  cards  with  "P",  on  which  sensi¬ 
tivity  calculation  is  desired,  must  appear  before  parameter  cards  with 
letter  "D". 


8  The  separable  and  quadratic  cards.  These  cards  arc  read  in  by 
the  subroutine  SYMPUT.  The  number  and  order  of  appearance  of  separable 
and  quadratic  cards  will  depend  on  the  problem  functions  being  coded  and 
their  canonical  formulation  by  the  user.  Each  separable  or  quadratic 
card  in  essence  provides  the  model  with  information  regarding  a  single 
variable  function.  With  this  information,  the  model  can  systematically 
synthesize  the  new  concomitant  variable  functions  and  subsequently  can 
reconstruct  the  problem  functions  and  their  derivatives  for  the  purposes 
of  various  calculations. 
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While  coding  these  cards,  the  user  must  be  aware  of  the  following 

facts: 

•  Separable  cards  may  appear  sequentially  in  any  numbers.  As 
long  as  they  are  associated  with  the  same  new  CVF  (CVF  in  columns 
04-07  of  Table  7),  the  single  variable  functions  in  each  car-4 
will  be  summed  up  recursively  by  the  model  to  construct  the  new 
CVF. 

•  Quadratic  cards  must  appear  as  pairs,  with  any  number  of  pairs 
permitted.  As  long  as  these  cards  are  associated  with  the  same 
new  CVF,  the  product  of  the  related  single  variable  functions  in 
each  consecutive  pair  will  be  summed  up  recursively  (if  there 
are  more  than  one  pair)  to  reconstruct  the  new  CVF. 

•  When  there  are  separable  and  quadratic  cards  associated  with 
the  same  new  CVF,  the  results  of  the  aforementioned  calculations 
will  be  summed  up  to  reconstruct  the  subject  CVF. 

Separable  and  quadratic  cards  are  described  in  Table  7.  For 
further  clarification,  the  reader  is  referred  to  the  formulation  and 
coding  of  the  sample  problems  provided  in  Section  4. 

9  The  bound  cards.  These  cards  are  read  in  by  the  subroutine 
SYMPUT.  There  are  two  types  of  bound  cards,  upper  bound  and  lower  bound. 
Tt  is  natural  that  these  cards  must  appear  after  the  concomitant  variable 
functions  that  are  being  bounded  have  been  defined.  Cards  relating  to 
equality  constraints  must  follow  the  cards  defining  the  inequality  con¬ 
straints.  Table  8  describes  bound  cards. 

10  The  flag  card.  The  user  must  indicate  the  end  of  his  problem's 
symbolic  factorable  code  by  furnishing  a  flag  card.  This  card,  which  is 
read  in  by  the  subroutine  SYMPUT,  must  contain  the  number  5  in  its  second 
column. 


11  The  tolerance  card.  This  card  is  read  in  by  the  subroutine 
MAIN,  and  is  described  in  Table  9. 
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TABLE  7 

THE  SEPARABLE  AND  QUADRATIC  CARDS 


Columns 

Format 

Name 

Description 

02 

A1 

ATYPE 

Letter  "S"  must  be  coded  for  ATYPE  if 
the  card  is  a  separable  card.  Letter 
"Q"  must  be  coded  for  ATYPE  if  the  card 
is  a  quadratic  card 

04-07 

A4 

ANAME 

Name  of  the  new  CVF  must  be  coded  for 
ANAME  (right  justified) 

09-12 

A4 

ARC 

Name  of  a  previously  defined  CVF,  in 
terms  of  which  the  current  new  CVF  is 
being  defined,  must  be  coded  for  ARG 

14-16 

A4 

AFUN 

Three-letter  symbolic  name  assigned  to 
the  type  of  functional  relationship  be¬ 
tween  ANAME  and  ARG  (see  Table  12)  must 
be  coded  for  AFUN 

17-28 

F12.5 

or 

3A4 

AClt 

•  The  value  of  Cl  in  AFUN  (see  Table 

12)  must  be  coded  for  AC1 

•  If  Cl  corresponds  to  a  previously  de¬ 
fined  problem  parameter,  then  the  pa¬ 
rameter  name  must  be  coded  for  AC1 
(right  justified)* 

29-40 

F12.5 

or 

3A4 

AC2t 

•  The  value  of  C2  in  AFUN  (see  Table 

12)  must  be  coded  for  AC2 

•  If  C2  corresponds  to  a  previously  de¬ 
fined  problem  parameter,  then  the  pa¬ 
rameter  name  must  be  coded  for  AC2 
(right  justified)* 

tReading  of  AC1  and/or  AC2  with  the  proper  F  or  A  format  in  the  model 
is  made  possible  by  utilizing  the  subroutine  REREAD,  which  is  a  built-in 
subroutine  at  The  George  Washington  University  FORTRAN  library  (see  Sec¬ 
tion  5). 

♦Parameters  with  alphanumeric  value  cannot  take  negative  signs  through¬ 
out  the  code  (i.e.,  -ABC  does  not  imply  the  negative  of  numeric  value  of 
parameter  ABC) . 
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TABLE  8 

THE  BOUND  CARDS 


Co lumns 

Format 

.  .  * 

Name 

Deser 1 pt Ion 

02 

A1 

ATYl’K 

Letter  "U"  must  be  coded  for  ATYPE  if 
an  upper  bound  is  being  imposed.  Letter 
"L"  for  a  lower  bound.  An  equality 
constraint  uses  either  letter. 

04-07 

A4 

A  NAME 

The  name  of  the  first  of  a  sequence  of 
CVFs  to  which  the  hound  applies  must  be 
coded  for  ANAME  (by  sequence  It  is 
meant  the  order  in  which  the  CVFs  ap¬ 
pear  in  the  code) 

09-  1 2 

A4 

ARC 

The  name  of  the  last  CVF  in  the  above 
(uninterrupted)  sequence  to  which  the 
bound  applies  must  be  coded  for  ARC 

17-28 

F12.5 

or 

3A4 

AC  It 

•  'Ihe  value  of  the  bound  for  the  above 

CVF  must  be  coded  for  AC1 

•  If  the  bound  corresponds  to  a  previ¬ 
ously  defLned  parameter,  then  the  pa¬ 
rameter  name  must  be  coded  for  AC1 
(right  Justified) 

ISee  the  footnote  of  Table  7. 

TABLE  9 


THE  TOLERANCE  CARD 


Co l umns 

Format 

Name 

Description 

01-12 

E12.6 

XEPl 

Ignored  by  the  program 

13-24 

E12.6 

XEP2 

When  minimizing  the  P- function  for  a 
given  value  of  r  (RH0)  the  value  of  P 
must  decrease  by  an  amount  exceeding 

XEP2  for  each  iteration  after  the 
first.  If  it  does  not,  then  the  code 
prints  out  the  message  "apparently 
roundoff  errors  prevent  a  more  accurate 
determination  of  the  minimum  of  this 
subproblem,"  and  it  is  assumed  that  a 
minimum  has  been  found.  (Usually  we 
set  XEP2  equal  to  0.) 
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MAIN. 


I"  Tht »  second  option  card.  This  card  is  read  in  bv  the  program 
The  description  of  this  card  is  given  in  Table  10. 


TABLE  10 

THE  SECOND  OPTION  CARD 


Option 

Column 

Value 

Meaning 

1 

7 

1 

Ignored  in  this  program 

2 

14 

l 

Tito  method  for  minimizing  the  uncon¬ 
strained  penalty  function  is  to  be  the 
generalized  Newton- Raphson  method  as 
modified  to  handle  indefinite  Hessian 
matrices.  This  method  requires  function 
values,  first  and  second  derivatives 

2 

Same  as  1,  except  that  when  an  "orthogo¬ 
nal  move"  is  made  because  of  an  indefi¬ 
nite  Hessian  matrix,  -VP  is  added  to  the 
orthogonal  move  vector 

3 

Steepest  descent  is  used  to  minimize  the 

P- function 

4 

The  method  for  minimizing  the  uncon¬ 
strained  penalty  function  is  the  rank 
one  method  as  reported  in  the  Fiacco- 
MeCormick  book  [10].  This  requires  func¬ 
tion  values  and  first  derivatives 

13  End  ceil'd.  This  is  the  usual  end  card  which  must  follow  any 
coded  problem.  It  contains  "//"  at  the  first  two  columns. 

A  schematic  depiction  of  a  problem  deck  structure  is  shown  in 
Figure  1. 

4 .  Coded  Examp  1  os  and  Output  _I  IJ  us  t_rat  ions 

For  illustration  purposes  the  coded  input  and  the  resulting  output 
for  the  sample  problem  1  discussed  in  Section  2  is  reviewed  in  sufficient 
detail.  Although  the  functional  relationships  involved  in  this  problem 
are  too  simple  and  the  problem  itself  is  too  small  to  illustrate  the 
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merits  of  SYMBOLIC  FACTORABLE  SUMT,  we  have  purposely  chosen  it  so  that 
users  can  readily  follow  and  become  familiar  with  the  model  with  the 
least  possible  effort.  For  further  elucidation  the  input/output  for  two 
more  sample  problems — Hopkin's  problem  from  Reference  |2]  and  the  bulk¬ 
head  design  problem  from  Reference  (5] — are  Included  following  the  sample 
problem  1. 

4.1  Sample  problem  1  (a  test  problem). 

4.1.1.  Problem  definition  (restated  for  ease  of  reference): 


minimize 

VX2 

subject  to 


(Xj-10)2  +  (x2-l)2 


x„  -  5  sin 

.  5x, 

< 

C, 

i  2 

1 

1 

x2  -  Cfi  In 

X1 

> 

C2 

x,  x„ 

> 

c„ 

1  2 

3 

xi 

> 

C4  * 

where  C,  through  C,  are  the  parameters  of  the  problem,  and  their  re- 
1  o 

spective  values  are 

C1  "  C2  “  0  *  c3  “  3  »  -  1.5  ,  C  -  1  ,  cb  "  -1-5  . 


Moreover,  let  us  suppose  that  we  intend  to  calculate  the  sensitivity  and 
elasticity  of  the  solution  vector  with  respect  to  the  parameters  C^  and 


4.1.2.  Symbolic  factorable  form.  In  SYMBOLIC  FACTORABLE  SUMT, 
use  of  canned  routines  to  evaluate  functions  of  one  variable  in  a  single 
Iteration  enables  us  to  code  the  problem  in  the  following  concise  form: 
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minimize 

h 

x6 

pijmbo  lie 

XcF/ 

factorable 

where 

x1 

s: 

X1 

s  tep 
(a) 

X2 

= 

X2 

(b) 

X3 

S 

C^X2  -  5  sin  .5X1 

(c) 

x4 

xs 

2  1 

X  -  C  In  X 
o 

(d) 

x3 

= 

1  2 

X  •  X 

(e) 

x6 

« 

19  9  9 

(X  -10)  +  (X  -1) 

<f) 

subject  to 

x3 

< 

C1 

(a) 

x4 

> 

c2 

(h) 

x5 

> 

C3 

(i) 

X1 

> 

C4  * 

(j) 

A. 1.3.  Tlu’  keypunch  sheet  code.  The  keypunch  sheets  used  to  code 
the  above  problem  in  symbolic  factorable  language  is  shown  in  Figure  2. 
Table  11  shows  the  correspondence  between  the  steps  cited  in  4.1.2  and 
the  related  symbolic  code.  Figure  3  depicts  an  annotated  computer  listing 
of  the  symbolic  code  for  problem  1.  The  categories  of  the  code  are  num¬ 
bered  and  specified  in  the  left  margin  of  this  figure  in  the  same  sequence 
as  was  Illustrated  in  Section  3. 

The  symbolic  names  used  in  the  code  are  directly  taken  from  Table 
12  at  the  end  of  the  present  section. 

4.1.4.  Output  annotations.  The  computer  output  for  the  sample 
example  1  is  depicted  in  Appendix  1  ,  page  50.  Various  segments  of  this 
output  are  numbered  in  circles.  Corresponding  explanations  are  as  follows: 

1  Information  contained  in  the  title  card 

2  Printout  of  SYMPUT  parameter  card  (the  reader  may  skip  reading 
steps  3-8). 
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NN>V*n 


H  . . 

*L  >*\ 
i  ’>r  '  J 

'••v,  .:/.• 


© 

NO  V* 

^  & 

^  <? 

V  \ 

tf  2$ 

\ 

V  vo 

NO 

§  s  S 
?*: 
5Sj 

T  *  H 
X  ^  £ 

sa 


s 

N  >» 

*  ^ 

*  X 

v  ^  ^ 

w 

N  v 

ft- 

N  ^ 

S>  ^ 

5  : 

^  ^  * 


ti 

i? 

^  ^  a 

s  ^  s 

v*> 


$ 


<\J  \ 

v 


fc  <5 

<\i  *a  ^ 


V>  Vr>  Vo  ^ 
.  •  Nj  • 

^  *  N. 


*  $ 
S  N  ^ 


N 

I 

^  V 


4 

5  * 


*s  M  V>  \A  «t  <\t  ^ 

\  S  u  vi  Vi  <j 


^  NN 

>i  M  <N* 

\  *  H 


S  3  ?  5 


Figure  2. — Data  cards  for  sample  problem  1 


Figure  2.—  continued 


'/AAAAAA  J()b  (5660,R).ABG 


=> 

s  * 

o 

II  c 
2  O 

C/5  f\J 

O  — 

ssli 

m  o 
o  c 

H  • 

X  o 


I  o 


Figure  3.— Computer  listing  of  the  sample  problem  1  code. 
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TABLE  11 

THE  CORRESPONDENCE  BETWEEN  FUNCTIONS  OF  SAMPLE  PROBLEM  1  IN 
SYMBOLIC  FACTORABLE  FORM  AND  ITS  SYMBOLIC  FACTORABLE  CODE 


*  *-  *  »  --V  « 

Symbolic  Factorable  Step 

Statement  Serial  Number  in 
Keypunch  Sheet  (Figure  2) 

(a) 

05 

(b) 

Ob 

(a) 

13  and  14 

(d) 

15  and  lb 

(e) 

17  and  18 

(f) 

19  and  20 

(g) 

21 

(h) 

22 

(i) 

23 

(J) 

24 

Segments  1-8  pertain  to  the  categorization  of  the  coded  symbolic 
input  by  the  subroutine  SYMPUT  which  is  necessary  for  svnthesis  of  the 
original  problem  from  the  symbolic  code.  In  order  to  make  these  print¬ 
outs  self-explanatory,  the  reader  should  notice  the  following  points, 
which  are  related  to  the  programming  logic  of  the  subroutine  SYMPUT: 

(i)  Separable  terms  are  labeled  with  a  type  number  ’'3"  and 
and  quadratic  terms  with  a  type  number  "4." 

(ii)  CVFs  are  sequentially  labeled  from  1  to  NN  (total  num¬ 
ber  of  CVFs)  in  the  order  of  their  appearance  in  the 
code. 

(iii)  All  the  problem  parameters  and  constant  coefficients 

are  sequentially  labeled  by  natural  sequence  of  numbers 
in  the  order  of  their  appearance  in  the  code  and  stored 
in  array  CC1.  Constants  having  the  same  numerical  value 
are  labeled  with  the  same  number.  Moreover,  in  this 
array  the  problem  parameters  are  separated  from  problem 
constant  coefficients  with  numbers  zero  and  one. 
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(iv)  Constraints  of  the  problem  are  sequentially  labeled  by 
natural  seauence  of  numbers  in  the  order  of  their  ap¬ 
pearance  in  the  code. 
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(v)  Each  symbolic  function,  as  discussed  in  Section  1,  is 

associated  with  a  unique  number  called  a  transformation 
code,  which  serves  as  a  link  to  juxtapose  the  symbolic 
function  name  with  its  mathematical  code. 

With  these  points  in  mind  we  proceed  to  review  briefly  segments 
3-8  of  the  output. 

3  Modified  printout  of  the  symbolic  code  of  the  problem  (ex¬ 
cluding  the  bounds).  For  explanation  of  columns  2,  (5,7),  and  8  ,  see 
comments  (i),  (ii),  and  (v) ,  respectively,  above. 

4  Manipulated  printout  of  problem  parameters  and  constants  (see 
comment  (iii)] 

5  Bounds  on  problem  constraints.  For  explanation  see  comments 
(iv)  and  (iii),  respectively. 

6  Number  of  times  that  a  concomitant  variable  function  (CVF)  is 
defined  in  terms  of  a  separable  one-variable  function  or  quadratic  func¬ 
tion  (cumulative).  For  example,  concomitant  variable  function  X4  is 
defined  as  follows: 

X4  =  X2  -  C2  Un  X1  , 

which  has  5-3  =  2  separable  terms  and  1-1  =  0  quadratic  terms. 

7  Table  of  separable  terms  formed  by  subroutine  SYMPUT  (self- 
explanatory)  . 

8  Table  of  quadratic  terms  set  up  by  subroutine  SYMPUT  (self- 
explanatory)  . 

9  Printout  of  parameter  card. 

10  Printout  of  first  option  card. 

11  Printout  of  tolerance  card. 
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12  Printout  of  second  option  card. 

15  Printout  of  initial  vector  and  corresponding  problem  function 

values . 

14  Printout  of  feasible  starting  vector  and  corresponding  prob¬ 
lem  function  values  (initial  vector  need  not  be  feasible). 

16  Objective  function  value,  solution  vector,  constraint  values, 
and  Lagrange  multipliers  evaluated  at  solution  point  of  subproblem  1  (at 
r  -  100)  .  The  following  information  is  also  evaluated  at  this  solution 
point : 

DOTT  :  inverse  of  Hessian  matrix  of  penalty  function 
pre-  and  post-multiplied  by  penalty  function 
gradient 

MAGNITUDE:  norm  of  penalty  function  gradient 

P  :  value  of  the  penalty  function 

G  :  dual  value 

RSIGMA  :  residual  term  related  to  inequality  constraints 
in  penalty  function 

H  :  residual  term  related  to  equality  constraint  in 

penalty  function. 

16  Printout  of  the  problem  parameters  on  which  sensitivity  in¬ 
formation  is  desired. 

17  Zeroth  order  sensitivity  of  the  first  component  of  the  solu¬ 
tion  vector  of  subproblem  1  (i.e.,  )  and  corresponding  elasticities 

with  respect  to  the  problem  parameters  (repeated  for  all  components  of 
solution  vector). 

15  Solution  to  the  second  subproblem  (at  r  =  10)  and  first 
order  estimates  of  solution  values. 

19  First  order  sensitivity  of  the  first  component  of  solution 
vector  of  subproblem  2  and  corresponding  elasticities  with  respect  to  the 
problem  parameters. 

20  Solution  to  the  third  subproblem  (at  r  =  1)  and  first  and 
second  order  estimates  of  solution  values. 

21  Solution  to  the  fourth  subproblem  (at  r  =  .1)  . 


30  - 


T-402 


22  Solution  to  the  fifth  subproblem  (at  r  =  .01)  . 

23  Solution  to  the  sixth  subproblem  (at  r  =  .001)  . 

24  Solution  to  the  seventh  subproblem  (at  r  =  .0001)  . 

25  Solution  to  the  eighth  (final)  subproblem  (at  r  =  .00001)  . 

Illustration  of  a  few  useful  optional  outputs  seems  beneficial  at 
this  stage. 

•  ITEST=0  rather  than  1  (in  SYMPUT  parameter  card)  would  sup¬ 
press  output  segments  numbered  from  15  onwards,  and  would 
instead  yield  output  segments  A,  B,  C,  and  D,  as  labeled 
on  page  64  of  Appendix  1,  and  which  have  the  following  des¬ 
criptions  (all  evaluated  at  the  initial  feasible  point) : 

A  ;  the  values  of  CVFs 

B  ;  partial  derivatives  of  the  new  CVFs  with  respect  to 
the  problem  variables 

C  :  diagonal  entries  of  the  Hessian  matrix  of  the  new  CVFs 
D  : 


•  NSWIT=1  (in  SYMPUT  parameter  card)  would  suppress  the  output 
segments  3-8. 

•  ITES=2  (in  SYMPUT  parameter  card)  would  yield  output  segments 

E,  F,  G,  H,  I,  J,  and  K  after  solution  of  each  subproblem,  which 
are  defined  as  follows  (all  evaluated  at  the  corresponding 
subproblem  solution  point) : 

E  :  the  entries  of  vector  0  (see  Table  4) 

F  :  the  entries  of  vector  a  [see  Equation  (38),  Appendix  2] 

G  :  the  values  of  CVFs 

H  :  partials  of  the  new  CVFs  with  respect  to  the  original 
problem  variables  premultiplied  by  vector  a 

I  :  the  joint  partial  derivatives  of  the  new  CVFs  with  re¬ 
spect  to  the  original  problem  variables  and  sensitivity 
parameters  premultiplied  by  vector  a 

J  :  the  partials  of  the  new  CVFs  with  respect  to  the  sensi¬ 
tivity  parameters 

K  :  the  negative  values  of  the  zeroth  order  sensitivity  of 
the  original  problem  variables  with  respect  to  the  sen¬ 
sitivity  parameters. 
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•  NT8=1  (in  first  option  card)  would  suppress  the  sensitivity 

and  elasticity  analysis  calculations. 

4.2  Sample  problem  2  (Hopkins  problem). 

This  problem  has  been  solved  in  Reference  [2]  using  FACTORABLE 
SUMT  (earlier  version  of  the  SYMBOLIC  FACTORABLE  SUMT).  Here  it  is 
chosen  as  the  acond  sample  problem  for  solution  and  sensitivity  analysis 
by  the  SYMBOLIC  FACTORABLE  SUKT.  For  brevity,  unlike  the  first  sample 
problem,  illustration  of  this  sample  problem  is  limited  to  the  algebraic 
definition  of  the  problem,  computer  listing  of  its  code,  and  selected 
pages  of  the  computer  solution  output. 


4.2.1.  Problem  definition. 

.5  „  _  .5 


minimize  (-lOOx^  -  2x0  -  25xl5  -  50x.'5  -  10xc  +  100 (x,- 3) 
*  1  2  3  4  5  6 


-  30x*^x*^  +  100xo  -  lOx  /x_  -  20x-/x.  ) 
1  /  o  13  14' 


subject  to  g  :  A  x_  +  A 0x~  +  A^x.,  +  A.x,  +  A_x«x,  +  A,x,x^ 

1  11  2  2  33  44  536  646 

-  A7x4x5x6  +  a8^1x7  -  A9xxx8  <  25,000 

g0  :  12.25x.  +  x0x.  +  . 7X.X.  -  .Ix.-x-x,  >  34,000 
l  1  3  6  46  4  5  6  — 

g3  :  x5  <  .5 


*8  -  -3 


85_814  : 


Xj  >  0;  j  =  l , 8  , 


where  the  coefficients  of  the  first  constraint,  i.e.,  A^-A^  ,  are  chosen 

as  problem  parameters  on  which  sensitivity  and  elasticity  analysis  is 
performed.  The  values  of  these  parameters  are: 

A1  =  24  ,  A2  =  12  ,  A^  =  .6  ,  A^  =  .4  ,  A5  =  .1 


,15  ,  A  =  -.15  ,  A0  =  11  ,  and 

/  O 


A9  =  24  . 
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4.2.2.  Computer  listing  of  the  symbolic  code.  (See  Figure  4.) 

4.2.3.  Selected  pages  from  computer  output.  (See  Appendix  L, 
page  69.) 

4.3  Sample  problem  3  (corrugated  transverse  bulkhead  design). 

This  problem,  which  has  been  taken  from  Reference  |5],  involves 
more  complicated  functional  relationships  than  the  two  previous  sample 
problems.  It  lias  been  solved  by  many  authors  |6],  [5].  (7),  [8].  A  com¬ 
parison  of  the  time,  cost,  and  effort  spent  to  code  and  solve  this  prob¬ 
lem  in  15]  and  [8] — where  the  SUMT- Vers  ion  4  model  was  used — with  those 
involved  in  the  present  study,  shows  the  enormous  advantage  of  the  SYM¬ 
BOLIC  FACTORABLE  SUMT  model  over  the  SUMT- Vers ion  4  model.  Table  13 
accounts  for  this  claim. 


TABLE  13 

SUMT- VERS ION  4  VERSUS  SYMBOLIC  FACTORABLE  SUMT  ON  SOLUTION 
OF  OPTIMAL  CORRUGATED  TRANSVERSE  BULKHEAD  DESIGN  PROBLEM 


Comparison  Criteria 

SUMT-Vers ion  4 
[81 

SYMBOLIC  SlIMT 
[present  study] 

Number  of  statements  used  to 
code  the  problem 

300+ 

100 

Approximate  time  spent  formulat¬ 
ing  and  coding  the  problem,  hrs 

25+ 

4 

CPU  time  spent  solving  the  prob¬ 
lem/  run,  seconds 

61.63 

27.64 

Cost  incurred  in  solving  the 
problem/run,  dollars 

5.08+ 

2.73 

A  comparison  of  the  entries  in  the  above  table  reveals  how  SYMBOLIC 
FACTORABLE  SUMT  facilitates  the  coding  of  problems  and  brings  about  sav¬ 
ings  in  time  and  costs  involved  in  the  solution  of  nonlinear  problems. 

As  mentioned  in  Section  1,  the  primary  reason  for  such  reductions,  espe¬ 
cially  in  the  coding  of  the  problem,  stems  from  the  fact  that  SUMT-Version 
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//AAAAAA  JOB  (  5660,  Rf  3,3).  AUG 

//  EXEC  FORG6, DSN=' ORbAAO .  ABG/  ,  PROC=M A I  N 

//SYS Lib  DD 

//  no 

//  DD  DSN=GWU.FoRTLIB,DISP=SHR 

//Go . FTObFOO I  00  * 

0.00001  100.0  .00001  1 0.0  100.  I?  3  0 

3  2  2  1  I  I  12  1  I 

EXAMPLE-2  i  SOLUTION  AND  SENSITIVITY  ANALYSIS  OF  HOPKINS  PROBLEM 
B  14  12  0  I  0  0  0  o 


V 

XI 

1  BO .  00 

V 

X2 

7  40 . 00 

V 

X3 

2A80.00 

V 

X4 

1 4AbO. 00 

V 

Xb 

.40 

V 

X6 

2. 30 

V 

X7 

.60 

V 

XB 

.20 

p 

At 

24.00 

p 

A2 

12.00 

p 

A3 

0.600 

p 

A4 

0.40 

p 

Ab 

0.10 

p 

A6 

0.  1  5 

p 

A  7 

-0.  lb 

p 

AB 

11.00 

p 

A9 

-24.00 

0 

X9 

X4 

IDN 

Q 

X9 

X6 

IDN 

0 

XIO 

X3 

IDN 

0 

XIO 

X6 

IDN 

s 

XII 

XI 

LIN 

A) 

s 

X  1  1 

X2 

LIN 

A2 

s 

X  1  I 

X3 

LIN 

A3 

s 

XI  1 

X4 

LIN 

A4 

s 

X  1  1 

XIO 

LIN 

Ab 

s 

X  1  1 

X9 

LIN 

A6 

0 

X  1  1 

X9 

LIN 

A/ 

0 

X  1  1 

Xb 

IDN 

Q 

XII 

XI 

LIN 

AB 

0 

X  1  1 

X7 

IDN 

0 

X  1  I 

X  1 

LIN 

A9 

0 

X  1  1 

XB 

IDN 

s 

X  1  2 

XI 

LIN 

1  2.2b 

s 

X  1 2 

XIO 

IDN 

s 

X  1  2 

X9 

LIN 

0.70 

Q 

X  1 2 

X9 
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-0.20 

0 

X  12 

Xb 

IDN 

Figure  4. — Computer  listing  of  sample  problem  2. 
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Figure  4. — continued 
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4  requires  explicit  derivations  and  coding  ol'  the  problem  function  gra¬ 
dients  and  Hessians  (user's  subroutine),  while  in  SYMBOLIC  FACTORABLE 
SUMT  these  requirements  are  internally  calculated  and  so  are  relaxed. 

The  derivation  and  coding  of  these  entries  is  sometimes  extremely  tedi¬ 
ous  and  time  consuming,  as  is  the  case  for  the  present  problem,  and  is 
prone  to  mathematical  errors  whose  debugging  is  another  factor  in  the 
user's  t  Ime  consumption.  It  was  this  very  fact  that  motivated  the  de¬ 
velopment  of  SYMBOLIC  FACTORABLE  SllMT,  and  the  present  example  clearly 
demonstrates  that  this  goal  has  been  very  well  achieved. 

It  is  not  the  intention  of  the  present  work,  or  within  its  scope, 
to  discuss  the  engineering  aspects  of  this  optimal  design  problem  and 
the  significance  of  its  constraints.  Readers  interested  in  such  aspects 
should  refer  to  [51.  Instead,  similar  to  the  sample  problem  2,  its  dis¬ 
cussion  is  limited  to  the  algebraic  definition  of  the  problem,  a  computer 
listing  of  its  code,  and  selected  pages  from  computer  solution  output. 


4.3.1.  Problem  definition.  Following  is  the  algebraic  defini¬ 
tion  of  the  problem,  borrowed  from  [51.  For  sensitivity  analysis  consid¬ 
erations,  the  coefficients  of  K,  and  t™*n  in  constraints  8-16  have 


been  normalized  to  unity  in  the  code  of  the  problem  (i.e.,  constraints 
8,  11,  and  14  have  been  scaled  by  -1,  and  constraints  ‘l,  10,  11,  12, 

13,  15,  and  16  by  -  ) .  The  problem  is 


minimize  W  =  l’B(x,  +x„)  ( fi.  x.+(!  xr+£,x,)[x1  +  (x^-xt)  i]  ' 

12  t  4  m  5  b  6  1  2  3 


subject  to 


com  t  mint 
numl'rr 


x ,  -  x  >  0  .  ( 1 ) 


1  c  2  2  2  S 

~r  x.,x,x.  +  -r  x.x.x.  -  K,h  4.  [x,  +  (x,-x.)  1  x  0  , 
ozjs  ZLJ4  Ittl  2  J 

6  X2X3X5  +  f  X1X3X5  "  Wmtxl  +  -  0  '  (5) 

6  +f  X1X3X6  “  KlVb[x1  +  (x2_x23)Sl  "  °  *  (4) 


6  X2X3X 
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1 

12  X2 
1 

12  X2 
1 

12  X2 


Tab  le 


page 


x5x4  +  f  xix3x4  "  2.2(K  h  £*)4/3[x  +  (x^-x^V / 3  >  0  , 

X3X5  +  t  X1X3X5  '  2*2(KlVm)4/3(xl  +  (x2_x3^1A/3  £  0  * 

X3X6  +f  X1X3X5  '  2-2(K1hbi^)4/3[x1  +  (x2-x2)Y/3  >  0  . 


10x. 

4 

10x. 

4 


10x5 

10x5 


10x, 

b 

10x, 

o 


[3.9 

[3.9 

[3.9 

[3.9 

[3.9 

[3.9 


x,  -  tmin  >  0 
4  t  ” 


1.05(.01h  ^(.OlXj)  10K2]  >  0 

1.05(.01hlt)ls(.01x2)  +  10K2]  >  0 

x,  -  tmin  >  0 

5  m  “ 


1.05(.01h,  )  *(  .Olx, )  +  10KJ  >  0 
lm  1  i  ” 


1.05(.01h,  K(.01x_)  +  10K„ ]  >  0 

lm  4  4 

*6  -  i 0 

1.05(.01h,J  YoixJ  +  10K„ ]  >  0 

lb  1  4  s3* 


1.05(.01h  )^(.01x_)  +  10K.]  >  0 

lb  4  4  = 


x^  >  0;  i«l,2,  and  3  . 


(5) 

(6) 
(?) 

(8) 

(9) 

(10) 

(11) 

(12) 

(13) 

(14) 

(15) 

(16) 


The  listing  of  the  problem  parameters  and  their  values  is  in 
14. 


4.3.2.  Computer  listing  of  the  symbolic  code.  (See  Figure  5.) 

4.3.3.  Selected  pages  from  computer  output.  (See  Appendix  1, 
78.) 
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//AAAAAA  JOB  (5660,R,4,4),ABG 
//  hXEC  F()RG6,DSN«'ORb660.ABGy  ,PROG= 

//SYSLIB  1)1) 

//  I)D 

//  DD  DSN=GWU.FORTLIB,DISP=SHR 

//GO. FT05F00 I  DD  * 

U. OOOO I  JOO.  .000001 

3  2  2  1  I  I 

EXAMPLE-3  *  SOLUTION  ANL)  SESITIVITY  ANALYSIS  OF  CORRUGATED  BULKHEAD 
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Figure  5. — Corrputer  Hating  of  sample  problem  3. 
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Figure  5. --continued 
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5.  General  Description  of  the  New  Subroutines 


The  following  is  a  list  of  the  names  of  the  subroutines  that  com¬ 
prise  the  SYMBOLIC  FACTORABLE  SUMT  model  in  alphabetical  order: 


BODY 

CHCKER 

CONVRG 

DLPEN* 

ESTIM 

EVALU 

EXDELP* 

FEAS 

FINAL 

GRAD 

GRAD1** 

GVALU* 

INVERS 

MAIN 

MATRIX** 

OPT 


OUTPUT 

PARSEN* 

PEVALU 

PUNCH 

REJECT 

RESTNT** 

RHOCOM 

SECORD 

SENS* 

STORE 

SYMPUT* 

TCHECK 

TIMEC 

VALU* 

XMOVE 


Subroutines  marked  with  a  single  asterisk  (*)  are  the  new  subroutines 
that  have  been  added  to  the  SUMT-Version  4  model  in  its  various  develop¬ 
mental  stages  to  result  in  SYMBOLIC  SENSITIVITY  SUMT  model.  Subroutines 
marked  with  a  double  asterisk  (**)  correspond  to  the  user's  subroutine 
in  SUMT-Version  4. 


In  order  to  provide  problem  function  values,  their  gradients  and 
Hessian  matrices,  users  had  to  code  the  latter  subroutines  in  SUMT-Version  4, 
while  here,  in  conjunction  with  the  new  subroutines,  they  are  modified 
to  serve  the  same  purpose  internally.  The  remainder  of  the  subroutines 
virtually  serve  the  same  purposes  as  in  SUMT-Version  4. 

For  brevity,  a  general  description  of  the  new  subroutines  is  pro¬ 
vided  here.  Readers  interested  in  general  descriptions  of  the  remaining 
subroutines  must  refer  to  [1], 

The  new  subroutines  fall  into  two  categories, 

(i)  those  developed  to  relax  the  user  from  coding  old  users' 
subroutines — these  subroutines  are  SYMPUT,  VALU,  and 
GVALU;  and 
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(ii)  those  developed  to  perform  sensitivity  and  elasticity  cal¬ 
culations —  these  subroutines  are  PARSEN,  SENS,  EXDELP,  and 
DLPEN . 


Following  is  a  brief  and  general  description  of  the  role  of  each 
of  these  subroutines. 


SYMPUT 

Reads  in  and  stores  in  arrays  the  coded  problem  in  symbolic  fac¬ 
torable  format  such  that  problem  functions  can  be  synthesized  with  the 
aid  of  these  arrays.  The  title,  SYMPUT  parameter,  and  flag  cards  are 
also  read  in  by  this  subroutine.  It  prints  out  a  modified  listing  of 
the  coded  problem  if  desired.  As  described  in  Section  3  (Tables  7  and 
8),  this  subroutine  selects  F  or  A  format  internally,  while  reading  the 
coded  problem,  for  numeric  and  alphanumeric  inputs,  respectively.  This 
is  made  possible  with  the  aid  of  subroutine  REREAD,  which  is  a  special 
purpose  George  Washington  University  FORTRAN  Library  routine.  Following 
is  a  brief  description  of  this  subroutine. 

"Subroutine  Name:  REREAD  -  permits  reformating  of  a  record. 

Descr ipt ion:  REREAD  patches  the  FORTRAN  1/0  routine  so 

that  upon  execution  it  examines  every  read  for  a  data  set  ref¬ 
erence  number  (device  code)  of  DO.  If  I1!  is  not  found  normal 
reading  takes  place.  If  19  is  found  reading  does  not  take 
place  and  the  record  read  by  the  last  normal  read  is  formated 
according  to  the  new  format.  The  call  needs  to  be  issued  only 
once  for  the  program. 

Usage:  CALL  REREAD 

Example:  DIMENSION  A(10),B(20) 

CALL  REREAD 


READ  (5,100)  A  This  will  read  10  variables 
on  a  card. 

READ  (99,101)  B  Tills  will  reformat  the  card 
into  20 A 1 . 


100  F0RMAT( 10F2.0) 

101  FORMAT! 20A1) ." 
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VALU 

Evaluates  the  functional  values,  first  and  second  derivatives  of 
single  variable  functions  as  required  by  C.VALU.  These  results  are  trans¬ 
ferred  to  subroutine  GVALU  via  common  blocks  to  reconstruct  the  problem 
function  values,  gradients,  and  Hessian  matrices. 

GVALU 

Using  the  information  stored  in  subroutine  SYMPUT  regarding  the 
coded  problem,  via  common  blocks,  GVALU  reconstructs  the  problem  function 
values,  gradients,  and  Hessian  matrices  with  the  aid  of  subroutine  VALU. 

P ARSEN 

Acts  as  a  coordinating  routine  to  conduct  sensitivity  analysis  in 
the  solution  vector  of  each  subproblem.  It  also  calculates  the  first 
order  sensitivity  information,  elasticities  of  solution  vector  with  re¬ 
spect  to  the  problem  parameters,  and  prints  them  out. 

SENS 

Evaluates  the  functional  values,  first  and  second  derivatives 
of  single  variable  functions,  partial  derivatives  of  these  functions  with 
respect  to  function  parameters  (Cl  and  C.2) ,  and  joint  partials  with  re¬ 
spect  to  parameters  and  function  variables  as  required  by  subroutine 
EXDELP,  This  information  is  transferred  to  subroutine  EXDELP  for  recon¬ 
struction  of  functional  values,  gradients,  Hessian  matrices  of  the  prob¬ 
lem  functions,  and  related  partial  derivatives  and  cross  partial  matrices 
required  for  sensitivity  analysis. 

EXDELP 

Using  the  information  stored  in  the  subroutine  SYMPUT  about  the 
coded  problem,  and  utilizing  the  information  calculated  in  SENS,  via 
common  blocks,  reconstructs  the  functional  values,  gradients,  Hessian 
matrices  of  the  problem  functions,  their  partials  with  respect  to  the 
problem  parameters,  and  Joint  partials  with  respect  to  the  problem  vari¬ 
ables  and  parameters. 
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DLPEN 

Using  the  information  calculated  in  EXDELP  via  common  blocks, 
uses  the  sensitivity  formulas  given  in  Appendix  2,  to  calculate  the 
zero th  ordei  sensitivity  of  the  solution  vector  with  respect  to  the 
problem  parameters. 

An  important  point  worth  noting  here  is  that  the  subroutines  SYM- 
PUT,  VALU,  GVALU,  SENS,  and  EXDELP  are  quite  general  subroutines  that  can 
be  interfaced  with  any  nonlinear  programming  algorithm  which  uses  the 
first  or  the  first  and  second  derivative  methods. 

Subroutines  comprising  SYMBOLIC  FACTORABLE  SUMT  are  currently 
dimensioned  to  handle  problems  of  the  following  maximum  scale: 

•  total  number  of  CVFs  <  100 

•  number  of  original  variables  <  30 

•  total  number  of  parameters  <  75 

•  number  of  sensitivity  parameters  <  15 

•  total  number  of  original  problem  constraints  <  200  . 

However,  if  computer  capacity  permits,  they  can  readily  be  redimensioned 
to  solve  problems  of  higher  dimensions.  All  of  these  subroutines  are  sep¬ 
arately  filed  in  the  TED  facility  [9]  at  The  George  Washington  University 
under  their  corresponding  names.  They  may  be  accessed  from  the  above 
source  using  account  number  55599  and  the  proper  password. 
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APPENDIX  1 

Annotated  Computer  Output  for  Solution 
of  Sample  Problem  1  (pages  50-68)  and 
Selected  Pages  of  Computer  Solution 
Output  for  Sample  Problems  2 
(pages  69-  77)  and  3 
(pages  78-84) 
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APPENDIX  2 


"Sensitivity  Analysis  in  Nonlinear 
Programming  Using  Factorable 
Symbolic  Input" 

(borrowed  directly  from  [4]) 
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SENSITIVITY  ANALYSIS  IN  NONLINEAR  PROGRAMMING 
USING  FACTORABLE  SYMBOLIC  INPUT 

by 

Anura  de  Silva 
Garth  P.  McCormick 


1 .  In  troduct ion 

This  paper  develops  a  methodology  to  utilize  the  input  to  nonlinear 
programs  in  symbolic  factorable  form  to  perform  first  order  sensitivity 
analysis  on  the  solution  vector  x(y)  e  En  of  a  general  nonlinear  program, 
k 

where  yeE  is  the  parametric  vector.  In  Section  2  we  discuss  the  key 
results  of  sensitivity  analysis  theory  in  nonlinear  programming.  In  Sec¬ 
tion  3  we  develop  the  formulae  underlying  the  new  methodology  to  utilize 
the  symbolic  factorable  input  to  perform  sensitivity  analysis  on  the 
solution  vector  x(y)  . 

The  above  are  implemented  via  the  SUMT  algorithm  [4]  for  nonlinear 
programming  which  uses  a  penalty  function  technique.  Section  4  briefly 
discusses  the  penalty  function-based  implementation  of  the  sensitivity 
analysis  methodology.  An  extrapolation  result  based  on  the  penalty 
function  parameter  r  is  stated  and  incorporated  in  the  computer  code. 
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Relevant  Results  from  NLP  Sensitivity  Theory 
Consider  the  problem 


MIN 

xeE° 

s.  t . 

where  G  : 

H  : 


Hx.y) 

C(x,y)  >  0 
H(x,y)  =  0 

En  x  Ek  -  Em 
En  x  Ek  ->  EP 


Problem  M(y) 


By  sensitivity  information  we  mean  the  rates  of  change  of  the 
(locally)  optimal  objective  function  value  and  the  corresponding  optimiz¬ 
ing  vector  with  respect  to  changes  in  the  parametric  vector.  If  x(y) 
is  an  n-vector  and  y  a  k-vector,  the  first  order  sensitivity  information 
for  Problem  M(y)  is: 


(a)  The  rate  of  change  of  the  solution  value  with  respect 

u 

to  the  parametric  vector,  D^Ffxfyj.y]  eE 

(b)  The  rate  of  change  of  the  optimizing  vector  with  respect 

dx  (  v  ) 

to  the  parametric  vector,  .  J  ,  where 

dy 


dx  (y) 
dy 


Sx^y) 


axn(y) 


ay, 


Dx^y) 


axn(y) 


ayi 


(i) 


The  first  order  sensitivity  results  for  the  general  nonlinear  pro¬ 
gramming  problem  were  first  s  ated  by  Fiacco  and  McCormick  in  [3],  Theorem  6, 
where  they  give  conditions  un  ler  which  a  smooth  (once  continuously  differ¬ 
entiable,  abbreviated  OCD)  tr  ijectorv  of  the  optimizing  Kuhn-Tucker  triple 
fx(y) ,u(y) ,w(y) ]  exist  for  v  close  to  an  initial  value  .  The  u 


and  w  are  the  Lagrange  multiplier  vectors  associated  with  the  inequality 
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constraints  G  and  equality  constraints  H  of  Problem  M(y)  ,  in  the 
Lagrangian, 

m  p 

L(x,y,u,w)  =  F(x,y)  -  I  u.  G.(x,y)  +  E  w.  H.(x,v)  (2) 

i=l  11  j=l  J  J 

where  u  .  ,G ^ ; i  =  l , . . . ,m  and  w.,H.:j  =  are  the  components  of  the 

mappings  G  and  H  and  the  Lagrange  multipliers  u  and  w  .  Here,  u(y)  and 
w(y)  are  che  values  of  these  multipliers  associated  with  the  optimal  value 
x(y).  They  assume  the  following  to  hold;  (a)  twice  continuous  differentiability 
(abbreviated  TCD)  of  L(x,v,u,w)  in  (x,y)  in  a  neighborhood  *f 
(x(y0) ,yg)  .  (b)  second  order  sufficiency  conditions  (abbrev.  SOSC)  at 
(x(vg),yQ)  »  (c)  linear  independence  of  binding  constraints  (abbrev.  LIB)  at 
(x(yQ) ,yQ)  ,  (d)  strict  complementary  slackness  (abbrev.  SCS) .  Here,  (c)  and 
(d)  are  regularity  conditions  they  invoke  to  obtain  the  key  result  in  a  useful 
form.  In  a  more  recent  paper  Fiacco  [2]  obtains  a  similar  result  for  some¬ 
what  more  general  parametric  problem,  such  as  M(y)  . 

The  crux  of  the  theory  is  the  application  of  the  implicit  function 
theorem  (see  [6]  for  a  general  treatment  of  the  implicit  function  theorem) 
to  the  first  order  Kuhn-Tucker  system  of  M(y)  ,  which  is 

Vx  L(x,y,u,w)  =  0 

ui  Gi/X,y'  =  G  »  *  =  1.*  ••»«!»  (3) 

Hj (x,y)  =  0  ,  j  =  1, . . . ,p  . 

Consider  a  system  of  equations 

D(x,y)  =  0  ,  xeF.n  and  ycE^  Problem  P(y)  , 

n  W 

where  D  :  E  x  E  -*•  E  ,  i  being  the  number  of  scalar  valued  functions 

in  D  ,  which  are  assumed  OCD.  This  ensures  the  existence  of  the  Jacobians 

of  D(x,y)  with  respect  to  x  and  y  ,  denoted  J  D  and  J  D  ,  respec- 

x  y 

tively.  With  the  sensitivity  analysis  context  in  view,  the  implicit  function 
theorem  could  be  stated  as  follows: 
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Theorem  1.  Suppose  D  s  En  x  Ek  -  E*  ;  (x(y0).y0)  is  a  zero  of  D(x.y)  ; 

D(x,y)  is  OCD  near  (x(y0),y0)  ;  J^D  is  nonsingular  at  (x(y0),y0)  . 

Then,  there  exist  open  sets  Sx(x(y0))CEn  and  Sy(y0)CEk  such 

that  for  any  y  e  Sy(y0)  there  exists  a  unique  solution  for  x  in  terms 

of  y  ,  i.e. ,  x  -  x(y)  e  sx(x(yQ))  ,  which  is  continuous  in  y  .  Moreover 
x(y)  is  OCD  at  yQ  and 

%  x(V  ■  -  [Vo]-1  [JyDo]  • 

where  the  subscript  0  on  D  denotes  evaluation  at  (x(yQ) ,yQ) 


If  p(y)  is  compared  with  (3)  the  role  of  Theorem  1  in  the  con¬ 
text  of  sensitivity  analysis  of  the  solution  vector  becomes  evident.  The 
assumed  TCD  of  the  problem  functions  gives  the  necessary  OCD  for  the  sys¬ 
tem  in  (3).  The  additional  conditions  of  linear  independence  of  tha 
binding  constraint  gradients  and  SCS  were  assumed  by  Fiacco  and  McCormick 
[3]  and  Fiacco  [2]  to  produce  desirable  results  such  as  the  uniqueness  of 
the  Lagrange  multipliers  [u(y),w(y)]  associated  with  the  optimal  x(y) 
and  the  invariance  of  the  set  of  inequality  constraints  binding  at  x(y0> 

in  a  neighborhood  of  yQ  .  The  following  representation  for  the  Kuhn- 
Tucker  triple, 

X  4  (x,u,w) 

and  X(y)  A  [x(y) ,u(y) ,w(y) ] 

will  be  adopted  for  notational  convenience.  For  the  same  reason,  the  first 
order  Kuhn-Tucker  system  of  (3)  will  be  denoted  as  follows. 

R(x,u,w,y)  =  0 

°r  _  (3b) 

R(X,y)  =  0  . 
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liquation  (7)  is  almost  the  same  as  the  result  stated  under  Theorem  1  but 
Is  stated  with  respect  to  the  entire  Kuhn-Tucker  triple,  X  .  Note  that  (7) 

Is  stated  for  y  in  a  neighborhood  of  ,  whereas  the  result  of  Theorem  1 

was  only  at  y^  .  This  is  possible  due  to  the  slightly  stronger  assumptions 

made  by  Flacco  and  McCormick  [3]  and  Fiacco  [2]. 

The  above  result  is  the  basis  for  the  development  of  a  methodology  for 
sensitivity  analysis  in  nonlinear  programming.  The  computational  technique  used 
here  is  the  penalty  function  method.  The  same  result  and  technique  were  used 
by  Armacost  and  Mylander  [1]  to  compute  (1),  the  principal  difference  in 
their  methodology  being  that  they  approximate  J^R  by  central  differencing 

techniques,  and  compute  all  other  derivatives  manually.  The  relevant  for¬ 
mulae  for  the  penalty  function  implementation  using  the  logarithmic  barrier- 
quadratic  loss  penalty  function  of  the  SUMT  algorithm  [4]  are  discussed  in 
Section  3. 

3.  Sensitivity  Analysis  With  Symbolic  Input 

The  factorable  input  technique  and  computer  code  to  compute  gradient 
vectors  and  Hessian  matrices  of  problem  functions  was  developed  by  McCormick 
[5]  to  facilitate  the  use  of  nonlinear  programming  computer  codes.  The  code 
itself  has  since  been  extended  by  de  Silva  and  McCormick  to  accept  input  in 
a  symbolic  format.  This  symbolic  code  has  been  used  to  solve  several  gen¬ 
eral  nonlinear  programming  problems  and  the  ease  with  which  a  problem  input 
can  be  supplied  or  modifications  done  is  very  encouraging.  A  sensitivity 
analysis  option  turned  out  to  be  a  natural  extension  to  the  symbolic  computer 
code. 

A  reduced  version  of  the  matrix  in  (1)  which  provides  substantial 
computational  economy,  results  from  the  formulae  which  are  developed  below; 
a  brief  discussion  of  the  factorable  input  philosophy  precedes  this  develop¬ 
ment  . 


In  the  factorable  input  method,  the  problem  functions  are  built  up 
recursively  as  sums,  or  sums  of  pairwise  products,  of  simple  transformations 
of  previously  defined  functions.  initially,  these  simple  transformations 
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are  applied  to  the  original  problem  variables  x^  ,  i  •  ,  and  the 

recursive  application  of  the  above  procedure  (shown  mathematically  in 
Equation  (8))  generates  new  functions  X*  ,  i  •  n+l,...,N  . 

McCormick  (5]  gives  a  detailed  exposition  illustrated  by  an 
example.  He  sets  X*  “  ,  i  “  l,...,n  and  refers  to  the  entire  set 

of  X*  ,  i  -  l,...,N  as  concomitant  vuriable  functions  (abbrev.  CVFs) . 

The  general  equation  for  the  creation  of  a  new  CVF  is: 

i-l  .  i-l  p  .  . 

X  tx)  -  l  Tl(XP(x)l  +  Z  T.  V*  lx P(x) )  •  U  „|Xq(x>)  .  (8) 

p«l  P  p»l  q-1  q,P  P,q 

In  the  presence  of  a  parametric  vector  y  ,  the  equation  becomes 
i-l  . 

X'(x.y)  -  r.  T  [Xp(x,y),y| 

P-1  P 

i*  l  P 

+  1  Z  v‘  lXP(x,y)  ,y]  •  V*  |Xq(x,y)  ,y]  .  (9) 

P-1  q-1  q,P  P,q 

The  terms  in  the  first  summation  of  (8)  or  (9)  are  referred  to  as 
sej>arjabJe  terms  comprising  the  new  CVF  Xi(»)  and  the  terms  of  the 
second  summation  of  pairwise  products  are  called  quadratic  terms.  A  point 
of  note  in  (9)  is  that  the  arguments  of  the  simple  transformation 

T*  ,  v*  or  U*  contain  v  directly  as  well  as  indirectly  via  the 
P  9,P  p.q 

argument  CVF.  The  direct  presence  of  the  parametric  vector  y  is  restricted 
to,  at  most,  two  components  because  all  the  simple  transformations  used 
In  the  methodology  and  code  contain,  at  most,  two  constant  terms.  The  para¬ 
metric  components  are  a  subset  of  these  constants. 

An  examination  of  (7)  suggests  that  second  partial  derivatives  of 
the  problems  functions  with  respect  to  x  and  the  cross  second  partial 
derivatives  with  respect  to  x  and  y  are  required.  This  is  because  R 
already  contains  f irst  partial  derivatives  with  respect  to  x  .  What  is 
developed  below  will  yield  the  matrix  in  (1)  reduced  by  postmultiplying  it 
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with  a  known  column  vector  0  e  E  or  premultiplying  it  with  a  known 
row  vector  o  e  En  .  The  postmultiplicatlon  produces  an  n-vector,  each 
component  being  a  weighted  sum  of  the  k  partial  derivatives  of  a  par¬ 
ticular  Xj(v)  ,  with  respect  to  the  components  of  the  parametric  vector. 

v 

The  weights  are  the  components  of  0  e  E  .  The  ith  component  of  this 
resulting  n-vector  can  be  looked  upon  as  the  "total  sensitivity"  of  the 
variable  x^(y)  (i«l,...,n)  with  respect  to  all  the  yj  ,  j  ■  l,...k  , 

weighted  according  to  0j,j"l,...,k.  The  rth  component  of  the 
k  xr(y) 

n-vector  is  E  — r -  0  .  The  premultiplication  produces  a  k-component 

j-1  yJ  3 

vector,  the  jth  component  being  the  "total  sensitivity"  of  a  composite  of 

all  n  variables  x^(y)  ,  i  ■  l,...,n  ,  weighted  according  to  o  ,  i  •  l,...,n  , 

with  respect  to  y^ (j*l, . . . ,k)  .  The  £th  component  of  this  k-vector 
n  3x^ 

would  be  T.  - —  o.  . 

i-i  3y<  1 

For  clarity  of  exposition,  (9)  will  be  simplified  below  to  a 
separable  portion  of  one  term  or  a  quadratic  term  of  one  product. 

Consider  the  separable  case  first.  Suppose 

Xi(x,y)  -  TfXP(x,y),yl  . 

Letting 

T  A  t  [XP(x,y),y]  A  , 

3XP 

wc  have 

V  X*(x,y)  -  V  xp(x,y)  •  > 

X  X  3XP 

-  T  •  V  XP(x,y)  . 


(10) 

(ID 

(12a) 

(12b) 
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In  (12b)  T  Is  readily  available  since  all  transformations  are  simple 
ones,  and  XP(x,y)  is  built  up  inductively  from  its  argument  CVF. 

2  i 

The  expressions  for  V  X  (x,y)  are  already  developed  and  coded  in 
15],  and  will  not  be  repeated  here.  Note  that 


V^xi(x,y)  =  y/u.y) 

-  D  D  T[XP(x,y),y]  . 

y  x 


(13a) 

(13b) 


In  (lib)  D  denotes  total  differentiation,  although  in  the  previous 
step  the  partial  differentiation  V  was  used.  This  is  due  to  the  fact 
that  the  partial  differentiation  in  (13a)  would  capture  the  total  variation  due 
to  x  and  y  of  the  expression  in  (12a),  but  not  so  in  (13b).  Continuing 
the  differentiation  with  respect  to  y  of  (12b),  as  in  (13b),  we  get 

V^xl(x,y)  ■=  v;xxp(x,y)  •  T  +  yP(x,y)  |‘f  [Xp(x,y),y]  vjxp(x,y) 


(1A) 


In  the  above. 


•  •  A  •  •  n 

T  -  T  [XP(x,y),y] 


A  a2T[Xp(x,y),yl 
n  1 
a(xl ) 


(15) 


In  (14),  T  and  T  are  readily  available  scalar  quantities.  The  quantity 
T  ]X*  (x,y),y]  is  the  true  partial  derivative  unlike  in  (13b).  This  is 
easy  to  compute  because  v  enters  the  T  argument  directly,  at  most,  in 
two  nonzero  components.  The  expression  for  V^XP(x,y)  has  been  derived 

already  in  (12a).  The  only  remaining  terms  are  XP(x,y)  which  is  built 

yx 

T  p 

up  inductively,  and  V^X* (xty)  which  is  discussed  below. 
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VyXl(x.y)  -  Dy  TlXP(x.y).y| 


-  Vy  Tlx1 (x.y).yl  +  T  •  VyXl  (x.y)  . 


Note  \  7(\  (x,y),>)  la  tho  into  partial  derivative  and  will  have  at  most 

two  nonzero  components  In  F  which  are  easily  computable.  Thus  (16)  per- 

T  n 

mits  the  computation  of  the  VyX* (x.y)  term  of  (14)  by  induction.  Since 
the  formulae  of  (12b),  (14),  (16)  are  Initially  applied  to  the  original 
problem  variables  X^  ■  x*  ,  1  -  l,...,n  ,  we  have,  for  p  <_  n  : 


Also, 


V  X  (x.y)  -  e  •  T 

X  P 


where  e^  is  a  unit  vector  c  En  with  unity  in  the  Jth  position. 


V2  X1(x,y)  -  V2  XP  +  e  |T  VTXP  +  V1’  Tl 
yx  yx  p  y 


Finally, 


-  e  V  T  . 

P  y 


VyXl(x.y)  -  VyT  +  VyXP  T 


-  V  T 
y 


On  page  6  ,  we  spoke  of  dimensionally  reducing  the  matrix  of  (1)  in 
two  separate  ways.  The  case  of  premultiplying  by  o  e  En  is  considered 
below. 


we  got 


Thus,  from  (17)  and  (18)  letting  denote  the  pth  component  of  a  , 

aTV  Xl(x,v)  -  n  •  T  .  (2< 

x  p 


r  2  l  T  • 

•  X  (x.y)  -  a  V*  T  , 
yx  7  p  y 


The  summation  of  (21)  will  have,  at  most,  two  nonzero  components  due 
to  the  nature  of  the  simple  transformations  used.  Next,  consider  the  case 
of  p  >  n  .  Here, 
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«T  Vx  Xl(x,y)  ■  aT  Vx  XP(x.y)  •  T  •  (22) 

Next , 

«T  £  Xl(x,»)  -  .T  £  XP(K.,)  •  f 

*  «T  Vx  XP(x.y)  <¥  vj  X^x,?)  ♦  vj  t)  .  (23) 

Kqu.it  ton  (22)  works  purely  inductively  and  does  not  require  the 
deliberate  Introduction  of  a  ,  as  this  has  been  done  in  (20).  It  is  a 
scalar  quantity  for  each  l  .  The  first  term  on  the  right-hand  aide  of 
(23)  is  also  an  inductive  term.  As  far  as  the  second  term  is  concerned, 

(the  scalar  multiplier  V  X*  (x,v)  ,  the  only  presence  of  a  there,)  it  is 

built  up  Inductively.  The  expression  within  the  curly  bracket  is  a 
k-vector,  the  first  term  being  an  inductive  one  as  demonstrated  in  (16) 
and  the  second  possessing,  at  most,  two  nonsero  components. 

In  summary,  we  have  a  scalar  quantity  for  the  reduced  version  of 
the  gradient  vector  of  each  CVF  i  ,  and  (20)  (or  (17),  if  p  n)  has  to 
be  repeated  for  every  p  corresponding  to  the  separable  terms  of  X*  , 
and  added  together.  The  reduced  second  cross  partial  of  each  CVF  i 
(as  show  in  (21)  or  (18)  depending  on  whether  p  ^  n)  is  a  k-v«ctor  for 
each  component  p  ,  which  must  be  added  together  as  before. 

The  quadratic  components  of  (9)  will  be  addressed  next.  Considering 
the  creation  of  an  X*  ,  i  ■  n+l,...,N  ,  using  a  single  product,  we  have 

Xl(x,y)  -  V(Xp(x,v) ,y] *  u(Xq(x,y) ,y]  ,  (24) 

then, 

VxX*(x,y)  -  nxV[Xp(x,y),yl  *  U[Xq(x,y) ,y) 

+  V(Xp(x,y) ,y )  *  D  U[Xq(x,y),y]  (25) 


-  VU  •  VxXP(x,y)  +  Vli  •  VxXq(x,y)  .  (26) 
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Now  V  ,  U  are  defined  ana  logouts  ly  to  T  (see  (11)).  Since 

•  •  n 

V  ,  V  ,  U  ,  U  are  scalar  quantities,  the  premult  ipl  ieat  ion  by  a  c  F. 

could  be  done  as  in  (20)  and  (22)  depending  on  whether  p  and  q 

are  <  or  >  n  .  The  separate  terms  in  ( 2 S )  must  be  added  together. 

The  result  is 

cJv^U.y)  -  VII  aTVxXp(x,y)  +  VI!  aTV  Xq(x,y)  . 

When  p  (or  q)  is  >  n  ,  a  VxXP  (or  a^V^X^)  enters  purely 

•  • 

inductively.  Otherwise,  the  term  simplifies  to  VI!  (or  VU  a^). 

The  second  cross  partial  derivative  is  obtained  by  differentiating  (26) 

with  respect  to  y  .  The  arguments  of  XP  and  Xq  are  omitted  for 
convenience  of  representation.  Finally, 

V2  Xi(x,y)  *=  U^V-V2  XP  +  V  XP[V*VTXP  +  VT  Vj^ 
yx  \  yx  x  y  y  ) 


+  V  •  V  Xp  •  D  U 
x  v 


{u*v2  xq  +  V  Xq[U**VTXq  + 
l  yx  x  y 


vy 


+  U  •  V  xq  •  D  v  . 
x  y 


Premultiplying  (27)  by  a  c  E  ,  and  rearranging, 

aV  Xi(x,y)  >  U  laV  XP  •  V  +  aTV  XP(V  •  VTXP  +  VF  V)i 
yx  l  yx  x  1  y  y  ) 

+  V  LV  xq  •  U  +  aTV  Xq(lf  •  VT  U]i 
)  yx  x  y  J 


T  P  •  T  a  • 

+  a  V  X  •  D  11  •  V  +  a  V  XM  •  V  D  •  U  . 
x  y  x  y 


The  evaluation  of  the  portions  within  the  curly  brackets  in  (28)  is 
Identical  to  the  evaluation  of  the  cross  second  partials  in  the  separable 
analysis,  i.e. ,  the  right-hand  side  of  (23).  The  last  two  terms  of  (26) 

contain  two  quantities  <iTVxXP  and  c^V  Xq  which  are  developed  by 

induction  as  demonstrated  bv  (12)  and  (20).  The  quantities  DyU  and  D^V 
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are  analogous  to  D  T  whose  computation  is  shown  in  (16). 


remaining  expression  to  be  developed  is  that  for 


The  only 


VyXi(x,y)  =  Dy{V[XP(x,y),y]  U[Xq (x,y)  ,y] } 


=  U{V*V  Xp+V  V}  +  V(U  V  Xq+V  U)  . 

y  y  y  y 


(29) 


Examination  of  (23)  and  (28)  shows  that  it  is  not  necessary  to 
premultiply  the  expressions  of  (16)  and  (29)  by  ,  since  VyX  never 

gets  directly  premultiplied  by  it. 


The  above  Equations  (20)  through  (29)  have  developed  the  necessary 
components  to  perform  the  computations  necessary  to  produce  a  row  k-vector 
T 

a  [dx(y)/dyl  .  The  next  section  describes  how  these  are  implemented  via  a 
penalty  function  method. 


4 .  Computation  of  Sensitivity  Results 

The  SUMT  computer  code  [  4  ]  is  used  in  conjunction  with  the  factorable 

T 

symbolic  sensitivity  analysis  code  to  yield  [a  dx(y)/dy].  The  code  uses  an 
interior-exterior  penalty  function  with  a  single  parameter  r  ,  and  generates 
a  sequence  of  subproblems  which  will  be  denoted  as  M(y,r)  ,  which  tend  to 
M(y)  as  r  -*■  0  .  In  straight  nonlinear  optimization  SUMT  uses  an  extra¬ 
polation  based  on  r  to  estimate  the  relevant  values  at  r  -  0  .  A  similar 
extrapolation  technique  is  used  here  to  provide  first  order  estimates  of 

[«Tdx(y)/dyl  . 

A  logarithmic  barrier  quadratic  loss  penalty  function  is  considered 
below.  For  M(y) ,  this  penalty  function  is 

2 

m  p  H,(x,y) 

P[x,y,r]  =  F(x,y)  -  r  Z  In  G.(x,y)  +  l  -J— -  .  (30) 

1-1  j-1  r 

The  problem  solved  at  the  J?.th  stage  of  the  sequential  procedure,  for 
a  value  r  =  r*  is 

MIN  Pfx.y.r*']  Problem  M(r,y) 

D0 

xeR 

where 

R  -  (x|Gj(x,y)  >  0  ,  i=l, . . . ,m}  • 
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The  optimality  condition  is  that  the  gradient  with  respect  to  x 
vanishes,  i.e., 

VxP[x,y,r*l  -  0  . 

At  local  optima,  tor  a  general  value  of  r  we  can  write 

Vxpix(y,r> ,y*r|  '  0  . 

Applying  this  to  (30). 

m 

V'ix(y.r).y|  -  ^  cJMyST.yl  '  •*> 

P  2  H  (x(y,r) ,y 1 


♦  £ 
i-1 


V  H  U(y.r)  ,y)  =  0 


Differentiating  (13)  partially  with  respect  to  y  ,  we  get 


v;xPlx(v,r).y,r) 


(31) 


(32) 


(33) 


-  V 


vx 


HI  , 

Flx(y.r).,)  -  ^  V^,, 
m 

+  l  L - -  .  V  G  (x(v.r).y]  •  V^O.  (x(y,r)  ,y] 

i-1  Gt[x(y,r),yr  y  1 

P  i  2  H  (x(y.r) ,v) 

+  r  v™Vx(y*r)-yl  •  — L~ - 

J-l  >x  3  r 


?  U)  V  H 

J«pr/  X  -1 


[x(y,r) ,y)  •  V*H [x(v ,r) ,y) 


(34) 


Pif f  ‘rent iat ing  (33)  totally  with  respect  to  y 

VxxP[x<y,r),y,rl  +  ^xP(x(y.r).y.r|  =  0  . 


(35) 
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The  argument  variables  within  the  square  brackets  will  be  omitted  when 

referring  to  the  terms  in  the  above. 

2  2 
V  P  has  been  developed  elsewhere  by  McCormick  [51.  Those  for  V  P 
xx  1  xy 

are  developed  using  the  equation  (34).  Thus, 

~ “  VxxP[x(y*r)*y»r]"1  *  VyxPfx(y,r)  ,y,r]  •  <3* 

The  similarity  between  (7)  and  (36)  is  to  be  noted.  Suppose  (36)  is 
premuJ t ipl ied  by  some  o  e  En  .  Then,  we  get 


T  dx(y,r)  , 

o  - - =  -  a  •  ^„vP[x(y,r)  ,y,r]  , 


where 


T  T  _2  _ .  ,  ,  .-1 

«  =  o  •  vxxp[x(y,r) ,y,r] 


If  o  is  a  known  vector,  a  is  determined  because  the  Hessian  of  the 
penally  function  with  respect  Co  x  is  known  by  [5].  Then  (37)  is  determined 
by  premultiplying  (34)  by  this  a  ,  and  using  (20),  (21),  (22),  (23),  (27)  and 
(29)  >o  determine  the  individual  components  of  the  resulting  equation.  This 
can  be  done  because  every  problem  function  F  ,  ;  i  =  l,...,ra  , 

Hj  ;  .)  =  l,...p  ,  can  be  identified  with  a  CVF  X*  ,  i  =  l,...,n  , 
n+1 , . . . , N  . 


The  final  aspect  remaining  to  be  discussed  in  the  context  of  the 

X  dx ( y » r ) 

sensitivity  methodology  is  the  improvement  of  the  estimate  of  a  — - 


extrapolating  on  r  ,  at  the  llth  sequential  unconstrained  problem,  to 
r  =  0  .  A  Taylor  series  approximation  applied  at  the  £th  and  (A-l)th 


subproblems  yields 


-  100  - 


T-402 


T-402 


REFERENCES 

11)  ARMACOST,  R.  I..  and  W.  C.  MYI.ANDER  (1973).  A  guide  to  a  SUMT- 

Version  4  computer  subroutine  for  implementing  sensitivity 
snn 1 vs l s  In  nonlinear  programming.  Technical  Pnper  Serial 
T-237.  The  Institute  for  Management  Science  nnil  Engineering, 
The  Ceorge  Washington  University. 

12)  ElACCQ,  A.  V.  (197h).  Sensitivity  analysis  for  nonlinear  pro¬ 

gramming  using  penalty  methods.  Mathemat leal  Programming 
$  (3)  287-311. 

II)  F1ACC0,  A.  V.  and  G.  P.  MCCORMICK  (19b8).  Nonlinear  Programing : 
Sequential  Unconst rained  Minimi  rat  Ion  Techniques.  Wlloy, 

New  York. 

|«1  HOLMES,  K.  W.  C.  MYlANDKR.  and  C.  P.  MCCORMICK  (1971).  A 

guide  to  SllMT-Version  The  computer  program  implementing 
the  sequential  unconstrained  minimisation  technique  for  non¬ 
linear  programming.  RAC-P-63,  Research  Analysis  Corporation, 
McLean,  Virginia. 

[5)  MCCORMICK,  C.  P.  (1974).  A  mini -manual  for  use  of  the  SUMT  com¬ 
puter  program  and  the  factorable  programming  language. 
Technical  Report  SOL  74-15.  Systems  Optiml ration  Laboratory, 
Stanford  University. 

(6 1  ORTEGA,  .1.  M.  and  W.  0.  RHKINBOLDT  (1970).  Iterative  Solutions 
of  Nonlinear  Equations  in  Several  Variables.  Academic  Praaa. 


102  - 


THE  GEORGE  WASHINGTON  UNIVERSITY 
Program  In  Logistics 
Distribution  List  for  Technical  Papers 


l‘he  George  Washington  University 
Ot  lie*  ot  Sponsored  Research 
Library 

Vie*  President  H.  r.  Hi ight 
Dean  Ha  to  Id  1.  lebowitz 
Dean  llanry  Solomon 

ONK 

Chief  ot  Naval  K**«areh 
(Codes  200,  4  14) 

Resident  Represent  at tve 

OPNAV 
OP -40 

DC NO,  Logistics 
Navy  Dept  Library 
NAVDATA  Automat  ion  Cmd 
0t*964 

Naval  Aviation  lntegiaied  Log  Support 

NARDAC  Tech  Library 

Naval  Electronic*  Lab  Library 

Naval  Facilities  Eng  Cmd  Tech  Library 

Naval  Ordnance  Station 
Louiavllle,  Ky. 

Indian  Head,  Md. 

Naval  Ordnance  Sys  Cmd  Library 

Naval  Research  Branch  Office 
Boston 
Chicago 
New  York 
Pasadena 
San  Francisco 

Naval  Ship  Kng  Center 
Phi  lade l ph la.  Pa. 

Washington,  IK 

Naval  Ship  Res  4  Dev  Center 

Naval  Sea  S vs terns  Command 
PMS  lObll 
Tech  Library 
Code  073 

Naval  Supply  Systems  Command 
Library 

Operations  and  Inventory  Analysis 

Naval  War  College  Library 
Newport 

UPPERS  Tech  Library 
FMS0 

Integrated  Sea  Lift  Study 

USN  Ammo  Depot  Earle 

USN  Pose  grad  School  Monterey 
Library 

Dr  Jack  R.  Bor sting 
Prof  C.  R.  Jones 

PS  Marine  Corps 
Commandant 

Deputy  Chief  of  Staff.  KM) 

Marine  Corps  School  Quant Ico 
Landing  Fores  Dev  Ctr 
Log 1st Ich  01 f icet 
Commanding  Officer 

liss  Francis  Marlon  (l.PA-249) 

Armed  Fori es  Industrial  College 

Armed  Forces  Staff  College 

Army  Wai  College  library 
Carlisle  Barracks 

Army  Cmd  &  Gen  Staff  College 


Army  Logistics  Mgt  leniei 
Foil  Lev 

i  oimuoud  t  ng  01  I  leer,  USALDMtA 
New  tumhiiland  Army  Depot 

Army  Invent oiy  Res  Oli 
I’ht  lade  lplila 

Alt  Foice  Headquarteis 
AFADS  l 
LEXY 
SAF/Alt. 

Cr tills*  Alt  Force  Ha»e 

Reliability  Ana  lists  center 

Gunter  All  Fori e  Base 
AFLMt /XR 

Ma swell  Alt  Force  Base  Itltaiv 

Wright  I'at  let  son  Alt  Fotci  Bast 
Log  i  onsnaud 

Research  si  It  l  og 
AFALD/XR 

Detense  Documentation  tenlei 

National  Academy  ot  Sciences 

Maritime  I  tans not  I  at  Ion  Res  Board  lihiai' 

National  Buteati  ol  standards 
Dr  H .  H .  Colvin 
Dr  loan  Rosenblatt 

National  Silence  Foundat ton 

Nal tonal  Security  Agency 

Weapon  Sv»  terns  Evaluation  t>roup 

Hi  It i eh  Navy  M  a)  » 

National  Detense  Hdqlis,  Ottawa 

Loglst  tew,  i)R  Anal vM»  Lst  nbl  twhmont 

Amet  lean  Power  let  t  o 
George  Che  mow  it  r 

General  Dynamics,  Pomona 

Genet al  Research  Cot p 
Dr  Hugh  Cole 
I thrary 

Logistics  Management  Institute 
Dr  Murray  A.  Ceisler 

MATH  I  I  I 

Dt  Flint  Feldman 

Rand  (  ot  pot  at  ioit 
1 tbrary 

tainegle  Mellon  University 
Dean  H.  A.  Simon 
Prof  C.  Ihompson 

i  ini’  Western  Resetve  University 
Prof  H.  V.  Dean 
Prof  M.  Mesatovli 

Prof  S.  Packs 

tot tte II  University 

Prof  K.  I.  Bechhof er 
Pro I  R.  W.  Conway 
Pro!  Andrew  Schultz,  Jr. 

towles  foundation  lot  Research  Itt  Economic* 
Prof  Met  be r l  scarf 
I'rol  Mat  in  shubtk 

'  lot  t it .t  St  i  e  University 

Proi  R.  .  Bradley 

Hat vard  U  , vers i t v 
Prof  K.  J,  Arrow 
Prof  W.  »  .  Cochran 
Ptot  An  bur  Si  Met  let,  Jr. 

Pt  tin  et  on  Unlvet  sit  v 
Pro t  A.  W .  Tucket 
Ptot  t.  W.  tukev 
Ptot  Geol l rev  s.  Watson 


fur due  University 

Proi  s.  »  >i»m  «i 

Prof  M  Hub  to 
Plot  And tew  Witt  list  on 

Stanford  University 
Prol  I  ,  W.  iVmlvtron 
Prof  u.  R.  D«nt  >  t it 
Ptof  V.  s.  Miller 
Prol  p.  L.  I  at  I  «* 1 1 ^ « t 
Prol  Samuel  Karlin 
Prol  .  J.  I  .iebeiman 
Prol  He  the it  Solomon 
Prof  A.  F.  Veinott*  Jr. 

University  of  California,  Berkeley 
Prol  R .  k.  liar  low 
Prof  P.  C.ale 
Prof  Ja*  k  Meier 
Prof  Rosed  ft h  s it  greaves 

I'M  vet  sit  v  of  ml  lfornl.t,  I  os  Angeles 
Prol  J.  K.  fackson 
Prof  R.  R.  o'  Net  11 

I'M  versify  of  North  Caroline 
Prol  W.  I  .  Stsfth 
Prof  N.  K.  Leadbetter 

University  of  Pennsylvania 
Prof  Russell  Ackof I 
Pr«»l  1  homes  I.  saat  v 

University  ol  lexis 
Prol  A.  Chatne* 

'ale  University 

Prof  F.  J.  Anscomho 
Prof  I.  R.  savage 

Prof  .  W.  Hltnhaum 

University  ol  Waahtngton 

Prol  H.  H.  Hiss  Inge i 

Ihe  Penns v l vents  State  imlvvrxUv 

Prol  seth  Homier 

University  of  Michigan 

Pro!  t..  r.  P.  Hox 

University  ol  Wisconsin 

Ur  Jerome  Hr sc ken 

Institute  tor  Vfeuse  Anslv.se* 

Prof  N.  Uhernol t 

Mss*.  Institute  of  Technology 

I’r  of  At  t  hur  Cohen 

Rutger*  -  Ihe  State  University 

Mr  Wallace  M.  Cohen 

US  t.enera I  Accounting  Office 

Prol  »  Herman 

Col umb t a  University 

Prot  Mnsao  Pukushtma 
kvoto  University 

Prof  s.»ul  I.  »  is* 

University  ol  Maryland 

Ur  ;Vna|%!  P.  Caver 
i  arme I ,  *  a  I  tfornt* 

Prot  Amttt  L.  u.oel 

y\ ra«  use  Uni  vet  sit  v 

Prol  t.  p  Hannan 

Michigan  Mate  University 

Prof  N.  ii  Hartley 

lexas  -i  A  M  Fonmlat  ton 


Mr  t.eta Uf  P  Hein 

NASA,  levin  Research  (enter 

Ptol  w  M.  MU  *i  h 
t  out  ant  Institute 

l)r  Man  Hoi  I  man 

1RM,  iotktovu  Heights 

Ptol  lohn  R.  Isbell 

Mate  ini  vet  sit  v  ol  N<  x  \ork,  Amlrrt  st 

Dr  I.  1..  lain 

University  ol  Delhi 

Ptol  J .  H.  k  kao 

Pol\te«h  first  t lute  ot  Nov  \ork 

Ptol  W.  kruskal 

Unlveraltv  ol  Chicago 

Mr  S,  kumat 

University  ol  Nadias 

Prol  C.  t.  Uemke 

Rensselaer  Polvte.h  Institute 

Pvol  \ ovnes 

University  of  Sheffield.  Png l and 

Plot  Steven  Nahmtas 

University  of  Pittsburgh 

Ptol  D .  H.  \N*en 

Southern  Methodist  University 

Ptol  K,  Vsy?en 

Texas  A  a  N  University 

Prol  H.  0.  Post  err 

University  ot  Connecticut 

Prot  R .  Rotas  go .  Jr. 

University  ol  Delaware 

Prol  Han*  Rledwl 

University  of  Hern 

Ut  Fred  Righv 

Texas  Tech  College 

Mi  David  Rosenb l *i t 
Washington*  D.  C . 

Prol  M.  Rosenblatt 

Unt'srsltv  ot  California.  San  Diego 

Prof  Alan  J.  Rn^vo 

University  of  Southern  California 

Prot  A.  N.  Ruhensteln 

Northwestern  University 

Dr  M.  F.  Salveson 
West  I. os  Angeles 

Ptot  Kdward  A.  Silver 

Diversity  ol  Waterloo,  Canada 

Prof  M.  J.  Sobol 

Coot g la  I  ns l  of  Technology 

Prof  K.  M.  Thrall 
Rice  University 

Ut  S.  Va Ida 

University  ol  Sussex,  Png  land 

Ptol  T.  M.  whtt in 

Weslevan  Uni verst »v 

Ptof  Jacob  Wo 1  fowl! r 

University  ol  South  Florida 

Prof  Max  A.  Woodbury 
Puke  Univetsltv 


lV>pmhei 


THE  qEORGE  WASHINGTOfrtpnVEisiSI’fY 


*■»>.*»  BENEATH  THIS  PLAQUE  -  )' 

■  '  '  ■  '  •  ,s  BURIED  I  . 

I  i.  a'vAULT  FOR  THE  FUTURE  '*  ‘  •' 

I  •*.  %  IN  THE  YEAR  2036 

I  OTE  STORY  OF  ENGINEtRINC  IN  THIS  YEAH  OF  IHE  PLACINC  OF  IHb  YAUO  AND> 
■ftWCfNEEBING  HOPES  FOR  THE  TOMORROWS  AS  WRITTEN  IN  THE  RECORDS  OP  THE 
>FOtX.OW/NG  GOVERNMENTAL  AND  PROFESSIONAL  ENGINEERING  ORCAN  HATTONS  AND 
jw fHQ $ E  OF  THIS  CEORCE  WASHINGTON  UNIVERSITY.  ,  *  ■}'r!  ■  -.»>y 

'  ,  BOARD  OF  COMMISSIONERS  DISTRICT  OF  COLUMBIA  "" 

UNITED  STATES  ATOMIC  ENERftY  COMMISSION,  ✓  '  --V 

DEPARTMENT  OF  THE  ARMY  UNTTED  STATBS  OF  AMERICA-  .  mP 


TffE  CHEMICAL  ENGINEERS  CLGB  OF  WASHING- 

WAStrrrrffrorr  scrciErv  of  engineers 

-  -  - ^  ISTCTJ  ARCHRfei 


.•  FAULKfftti  KINGSBURY  4  - STENHOUS 

V-  FFTA  RT  ES  ft  “TO WFK I  NS  CoMPANYtSR 

SoerPTV  OF  V/OWE  N  EfJGfN eerS^J 

«  ff#mrrt*L  xcSioemv  of  science^ 

THE  PURPJ OSE  OF  THIS  VAULT  TO 

*  •  'JiKeHARtES  HOOIcShH 

rFCA  USE  Jjf  jTtS  ENGINEERING  COtffiSlT&jOT 

hk  NAnoiN.  and 

^  -hi  B V  THE  CEOR«g 


If  NG 

•board  of 


RUST 


I  o  cope  with  the  expanding  lei  hnologx .  our  sot  iolv  must 
Ik’  assured  ol  .1  continuing  supply  of  rigorously  Ir, lined 
dnd  cduc  .ik'd  engineers.  I  ho  School  ol  I  ngineering  and 
Applied  Science  is  completely  committed  lo  this  ob¬ 
jective. 


